He's probably using a variation of that excuse with his wife.

Wife: "Have you been having mad monkey butt sex with guys?"

Haggard: "No, no, no! I always pull up my pants before he can stick his dick in me!"

Wife: "Oh. Well. That's okay then."