Don't panic. It happens. Just continue to monitor the hermie and pluck those male parts. The ones that have already opened were probably immature. You may still wind up with a few seeds but it's no big deal. I still have some seeds from a hermie to use in case of an emergency.