Problem here is they are killing your plant and laying eggs in your bud. Not to mention all the waste and carcasses left behind. Harvest now or harvest later, I wouldn't want to smoke the bud. Wait as long as you can harvest it and cook it or make hash but smoke it at your own risk.