They can push federal law on you even if your state doesn't treat it as a big deal, too. So don't go pissing off any federal agents.

Either way, in any state, they can ring you up for conspiring to traffic illeagal substances, conspiring to manufacture, all kinds of conspiracy that will more or less get you fucked if the case has anything at all to do with federal law.

Some states are more lenient than others. Everything also varies case by case. But, no way in Hell you aren't going to jail for getting caught growing a controlled substance if somebody wants you to go to jail for it. Be it one plant or a whole field.

Your general rule of thumb should be why the hell are you worried about getting caught? If there's any chance of that happening, abort. If part of your growing plans include how to weasel out of jail when I get caught then hit the drawing board.