If it's just one or a few little wormies, why not share and let them enjoy as well? Now, if it's something voracious, like a hornworm, then you need to pluck them mercilessly. Do hornworms bug cannabis? Terrible pests, those.