hi mate, just took a look at your pics and i think you have a catapillar prob, those younger tip leaves are getting munched like there is no tommorrow, those long green stems you can see are the remains of the leaves, 1 single catapillar can wreck a plants bud or flower in no time at all, dont matter if its a male or female, best find the little bugger and give him the good news before he does any more damage. look for larger leaves that seem to be wraping themselfs up, the cat will almost certainly be green and will very well camoflauged, i get that prob each year with my out door stuff, if you have other plants nere it check them throughly, there are pestercides that will deal with it, but hey who wants to smoke pestercides......
.............. peace ............... happy ..................