Dont worry... it takes awhile for a male to pollinate. You will have plenty of time to remove them after you know for sure.