if there is a seed , a male pollen was definately present, rulling out that ya have another male plant in there! then you have a hermie somewhere!, if the male flowers are just occasional on the buds itself, they may only self pollinate, however if you got good circlation of air the flowers could be pollinating the whole room!,
if you already have mature seeds on the plant, then the male flowers have done there damage a couple of weeks ago, and you missed them!
the other option is that they are hermie male flowers or banana type flowers, these rearlely pollinate more than the bud they are on, it is these flowers that are used to create feminised seeds, not the normal looking male flower!
suggest you grin and bear the consiquences now, and if all else fails pick out your seed, or make hash or oil, although if u dont have alot , just put up with picking out the seeds, and get GOOD beans next time!
if you know what a male flower or hermie flower looks like, i suggest you scan every indh of your plants to find out where they are!, often the lower branches only are affected!, these can be removed!
removing the clusters of flowers wont achieve much unless you intend to be Extreemly vigilant! the plant will replace them with even more! removing the branch will completely remove them from the plant, and it will take longer to recreate new buds or limbs, this is only any good if its the male type flower,not the hermie banana flowers on the bud!

good luck!