You should only worry when it lasts longer that 6 minutes. If it is only 5 minutes right now, you should be ok.

I have had that same pain before though. When I smoke out of bongs I get chest pain, so I try and never smoke out of them.