could the libido bit be linked to the fact that he knows he's letting me down and feels a bit ashamed of how he's been treating me?
It's not a problem I've had to deal with before!