Definatly catapillars...they craped all over my plant too.
You need to get some cattapillar spray.
I searched through the buds to find them and kill em'.
Look for little white or yellow eggs on the outside of the flower and pull them off.