I smoke a lot and happen to be a pretty productive person.
But just as in your case, smoking with the fellas too often tends to mess up my rythem and i get nothing done. Whenever that happens i just get back to the basics, slow down my toking a bit and leave the hanging out alone for a while.