I know what you mean. I have about 3 different sets of friends that I do not mix. School Friends/Pot Friends/Party Friends

I have taken girls who thought I was very softspoken and insightful to a 4 kegger where all my party 'crowd' friends are getting down.

Drunk Buddy: "dang mar, shes not very fun...do you actually like her? Cause I don't like her, shes fawkin boring"
Me: "yeah, shes a pretty nice girl, shes alright"
Drunk Buddy: "Uhh, alright dude. Whatever."

Girl: "wow mar, these guys are really partying hard and crazy! How do you know these people??!! OMG, did that guy just pour whiskey in that beer bong?"
Me: "Uhh, yeah, thats TJ, we grew up together....."