I read somewhere that after a plant hermmies, it developes a gene that stays in its offspring and will cause them to hermmie. Now this gene CAN be recessive at times and skip a generation, but it is nearly imposible to get rid of that gene. I would say that if you had no other choice, keep the seeds, but you might want to keep the hermmies sepperate form all of the other plants.

Please be aware that I am a n00b, so I wouldn't doubt it that this is wrong. If anyone could back me up on this, that would be great, or prove me wrong. I just don't want to give you any false information.