I drink coffee all the time - quite often either while, or shortly after smoking, and I have never had any problem with it at all. And this is over the course of about 25 years.....
Instead I would like at other issues, like how long was it sitting around, old milk/cream (If you use it - I take my coffee Black and sweet), behaps something compleately differant even...All I can say is it never happened to me.