Most all growers around here wait for at least after the first frost to harvest (whether they can "read" the trychs or just the hairs). Pot is very hardy to light frost. As my southern neighbor, Stinky says, a killing frost is the end.

Shov