I would call the police and say that you think theres a man with a gun on your street, and you think hes selling drugs.
Besides, with California's revolving door judicial system, hell be out in just a few hours, which gives you plenty of time to plant more drugs in his home, so hell be ready to go back to jail that evening. I think that would work swell.
Or you could wait until he goes to work in the morning, hide in a bush, and whack him with a collapsable baton in the back of the head. Hell be late for work, and he wont remember who hit him.
Or you could habitually let the air out of his tires week after week.
Or you could pour sugar in his gas tank........
But all those would be childish.
All of the aforementioned sound like ideas you want, but I would let it go and learn from it. I would just never speak to them and let it go, no sense in doing anything that could get you in trouble for the lowlife.
Good luck man, I hope you are able to more properly secure your belongings.