I rarely rare a shirt around the house, and sometimes i'm in the buff when its just me, or me and the girl.

Anyway, i wouldn't care that my friend was in his boxers all the time, but I'd think he was lazy.