To me, the pitfalls are pretty simple:
-Dry throat, dry hacking, wakes me up at night if I smoke out of a bowl or joint. A little less severe with a water pipe
-Escapism... if you're prone to it, deal with the issues instead of getting high! Same goes to alcohol and other drugs.
-yeah I get a bit forgetful... um... what were we talking about?