Those are great points, especially the final statement. If were not smoking at work, it is irrelavent.
But on the other hand, if you have medical benefits from a company, they do not want to end up paying for some lung disease because you smoke trees recreationally.