outdoor caterpillar attack need help!

[blowin]

so since young i feed and foliar; neem oil,insect soap, everything was going well. now i check outdoor top buds and i see green caterpillar and black dots. some bud is rotten and broke off
what to do? foliar neem? or rinse water early?