Yeah you have to learn to chill from the beginning or it's going to get worse. I used to be really paranoid and it doesn't just go away. Just avoid situations that are going to be scary and make you uncomfortable and learn to realize that your fears are mostly irrational. It helps to be with a friend who can help you calm down.
Also, for the future, I would stay off shrooms if I were you.