Werd bro, I feel you. I have one piece of advice, have a talk with them. Say yo, if youre gonna act like a fuckoff when I'm high than I won't chill with you high, just say the word. But yea I have the same problem, I just don't chill with people that don't smoke when I'm high. Simple as that