The Dr. told me the recommendation was nothing more then a legal document to give to your attorney in the event you are arrested, it does not preclude LE from taking your plants and/or arresting you.

I have however been in a home where a small grow was happening in a bedroom and LE was called, my friend took them right to the room, showed her paperwork and the sheriff only told here "we just want to make sure you're not operating a large scale growing operation". Home reeked like freshly smoked pot, cop never asked me anything and left.

It sounds like you are doing all the right things though, keep it hidden and don't tell anyone. My biggest fear is rippers. Keeping a copy of your recommendation near your garden may prevent LE from pulling your plants if for some reason they came to your place while you were not home. I'm pretty sure they aren't worried about three plants but if someone were to call they could ask to search your place.