You really need to ask your ex why they just wants sex and not a relationship.I could guess at the fact that they want you but doesnt want to commit.If you don't mind being used for sex then carry on seeing them but if you want more I think you should just walk away.

I wouldn't sleep with any of my ex's it would just complicate things and someone always gets hurts.