If he's been talking about your plants too, you don't want to risk it. Unless you are 100% legal (or 100% sure you won't get caught), I would pull your plants (if you have any) too. He definitely should be pulling his plants. A plant is not worth getting a record. This is a learning experience about opening your mouth...