Yank off the male flowers. Really. It's too late to worry about a relatively insignificant stress like that when you've already got herms. You could be getting them from high temps nearest the light. It's a common cause of nanners.