No, dont kill em. If they havnt pollenated themselves yet, then pull the balls off now. Then just grow the plant as normal and keep pulling the balls of as you see them.

If the male part has pollenated your plants then you must let the seeds mature. There's a higher chance of them seeds being hermie, but its not set in stone so as long as you treat them with alot of TLC they'll be ok