Those "fruit fly's" are likely fungus gnats. Although your correct that the fly's themselves don't do any damage. The maggot babies suckling your roots will!