Whatever is more important to you. If I was in your situation I would lay off the herb. In the end, you'll probably be happier having not lost good friends. If all of your friends are worried, you might evaluate your own life and see if they are perhaps justified. Just a thought.