When you see seeds starting to form the male is no longer needed. You can take him out.