I have mild hayfever allergies and have smoked for years...
Take it slow, if you're really sketched out, make sure you have someone with you in case some fucked up shit goes down.