High 30's are fine at night. Up this way we've been getting colder than that, and doing good. They can take a LIGHT frost and manage.
1 of the main rules is NEVER bring your outdoor plants inside,
I had 1 outdoor plant in a pot that I had to move, and when I tugged on it, I think the main tap root was affected, and though it didn't die, it was never quite the same.
You have to decide if your outside plants are worth infesting the inside ones.
Personally, I'd leave it.