This is why I would construct a secret "bat-cave" before any growing went down.
Honestly, I don't think you have much to worry about, unless you frequently see cops around your place. If you decide to dispose of the plants, be careful because if he's suspicious about YOU and you're walking around with two BIG-ass bags smelling like plants or weed, he might take a look... and then you die .