I know what you mean, its very odd, but ive been smoking pot since grade 9 every day, and tripping on dex, and shrooms along the way mutiple times... Yet at school im usually the smartest kid around, and i know the answers to most questions, and get great marks on tests...

I guess for some people the stress releif, and ulimate clearing of the mind caused by psychedelics, opens up different parts of your brain.
I know since i first tried mushrooms, i have been drawing, and speaking alot better than i used to...i can also more easily explain ideas in detail.

So i think tripping on shrooms isn't too bad for you at all...I've never tried e, or acid (yet) but im sure acid isn't too harmful either..
E on the other hand can be deadly...(had friends get fucked up from it)