Too late, I already have nice buds forming. Looks like one plant is heavily infested (about 30% of the buds are dying), and the other is lightly infested.
I may be smoking some dried worms this winter.
I'm going through cutting out the dead buds, hoping to save the rest of the plant. Next year I'll try the caterpillar spray. I'm wondering if planting them next to the tomato plants this year is what did it- I've never had them near my vegetables before.
Thanks for your help!