I'd leave it! Sounds as if it's stressed by it shrivling.What are they potted in? Are they indoors or out? Could be an insect.Wasps will sting a plant.

Ga Grown