I always just assume it's an ex-girlfriend or boyfriend unless specified otherwise. I for some reason, don't think of someone calling their ex-wife an "ex" but actually saying "ex-wife" (or husband). I feel like that SHOULD be specified. I don't know if I'm making any sense so I'll end it at that.