Keep picking them off. Wet your fingers with water before you pinch them. There's nothing much else to do- there's a product called 'reverse' that prevents pollination, but it's too late to use it. And next time, go for genetics that herm less easily.