I own and have smoked out of both... I'd recomend glass more so, as metal does have its downsides such as the chemicals or what not.

Its mostly wives tales, as inhaling smoke is worse for you than anything else that would enter your lungs form a metal pipe.