BobBong's right. Lose that guy. It sounds a heck of a lot like he's playing you for what he can get out of you--a place to stay if he needs a backup plan for someplace to live and occasional sex when he's in the mood and not with his other girlfriend(s). "I still love you and want you" is the oldest line in the book when someone wants to keep a girl on the hook but not really have a relationship with her.

You're still fairly new to relationships if he was your first, so trust me on this. Love doesn't have to hurt or be confusing. Muster up enough self-confidence to resist this guy's periodic advances and hang in there till someone who'll treat your right comes along. Love him or not, this guy's too much of a playa and a user to ever be anything but pain for you.