I had some caterpillar problem before, but they seems to appear at night and gone in the morning. Turned out they burrow in the soil during daytime. So you can try to dig around to see if you can flip out some to reduce the damage.