NO IT WOULD NOT.

I speak to you from experience, I've done it many time. Load a bowl, put the piece in the freezer, and then smoke it. The piece will only stay cold for about the first to second hit before it's back to normal!

Don't worry about it cracking! Mine never did.