You've already had problems with bugs, I'd get rid of the yellow leaves.
Is it one of the clay watering indicators you mentioned?
If so, they aren't very accurate. A few years ago I tried some in our houseplants. Were kinda ok for houseplants, but a fan would dry it out making it look like the plants need water, when they really didn't. I'd still check with my fingers to make sure.