no it is not bad because of temperature changes (I assume you keep your house above 65 degrees.... ) aaargh

i would be aware of the possibility of bringing pests indoors, and of giving an irregular photoperiod.

have you thought about just keeping them inside under a shop light until it is time to flower? Or leaving them outside all the time?