Plants aren't flipping teenagers, and its not every time your turn your back, they're sexing! Normally a male flower has to go through stages before it can pollinate so you could always remove first sign of nuts everytime you see them. Of course some people recommend having different rooms as if you live in some theoretical perfect cannabis mansion or something.