Organizations already HAVE done studies that show them to be very conclusively safe. Any psychiatric detriments are few and far between, and are usually pre-existing conditions that were only potentiated by the mushrooms. Used sensibly, mushrooms are one of the safest substances you can possibly consume.

Of course, you should avoid ridiculous things like driving, tripping while pregnant, or eating exorbitant amounts.

I don't know why you're so sketched by shrooms man, really. A bit of reading and it's all there.