Not a problem... just clean em up and get them out of the room as they pose a threat with pests and such. If you are losing top foliage, that's another story but you are fine no worries friend