The water will drain into the bottom cup, but there it will stagnate in anaerobic conditions, create a place for pathogens to fester, and prevent oxygen re-entering the cups.
Just make sure you have nice big drain holes in the cups, and next time they are light, give them a HEAVY watering with plain tap water. Nitrogen is VERY soluble and that will really cut back on the avialable amount in the soil.