might just be the people youre smokin with. Try smoking with only your closest friends or even by yourself once and see how it feels. If its still not for you then thats cool but that first time is kind of an unprecedented experience. After a little while you stop thinking "holy shit i'm fucking high!11!" and start enjoying the feeling

With the exception of some crazy nights with huge amounts of high end widow shit or hash, I've never tripped as intensely as I did the first few times I smoked. Personally I kinda see that as unfortunate but I can see how the intensity of that first high can freak you out