I have had seeds a few times and I honestly did not notice any difference in either yield or potency. By the way, every seed I have planted from my hermies turned out to produce a female plant and some were hermies when grown out and some were not. (All produced great smoke)

I don't mean to say that you should avoid caring about preventing seeds altogether but a few here and there does not seem to be much of a problem.

If you can, trim off any "male parts" you find in your grow if possible and of course rip out any male plants but I would not worry too much about the hermie situation. You will still get great buds from your grow.

regards,
Max Blast