Sounds like you have yourself some fungus gnats. Usually due to over watering. Try and keep the soil on the dry side. They will feed on fungus, organic material and lay eggs in your soil. Eliminate the fungus and you will eliminate the gnats.