If he ditches you for that, hes not really a friend.

One of my friends stopped hangin' out with me cause I smoked weed. Blamed it entirely on me, "we were great friends untill you started smoking pot!" etc. And a year later the kid is a stoner...

Fuck him though, his loss.