I wouldn't worry about it. If I remember correctly, there are actually spores that are released during late fall that kill off flies. So even the ones that don't die from the cold, die from the spores. There are some flies that survive though, but they wont be able to create any sort of infestation that you would need to worry about.