I used to have terrible paranoia and anxiety in High School. It got to the point where I had to drop out for a while, and then get my diploma at a CC. It was all due to marijuana abuse. But, I kept smoking. I wasn't going to let a little panic attack stop me from doing what I loved.
A lot of my friend's went through the same thing, and they quit as a result. I just smoked straight through my paranoia, and now I don't suffer from anything but the munchies. If you can handle it, I suggest you just keep sailing in the eye of the storm. Because on the other side theres sunshine, and a lot of it.