Well probably not but one persons word is enough for the police to probe for other evidence. Even though he did trespass on your property the police would probably outrule it because of what he discovered. I would play it safe if i were you but the thing i would do before moving all of it is too call this guy up, im sure you would be able to find out who delivered your package on that day through ups. Call them up and make up a fake story as to why you need to contact the delivery guy who delivered on say wednesday or whateva. Get in contact with him, see what kidna guy he is, see if hes a grass or not and go from there. I mean not everyone is a snake, i certainly wouldnt report any grows to police and i know alot of other people wouldnt. AND another thing is he may just think your a medical grower and though nothing of it ! If you live in a MMJ state i dont know.