I've asked this question of the DOH and the DOR and the best answer I got was to only grow for those who you consider your patients.

So, if you had 20 patients, and went down to 5 plus you (and you are a patient), and you have plants just to cover those reccomendations, you should be fine.

I keep a book with the paperwork in it onsite and offsite, and make sure I have less plants than I am covered for...