I know you said to forget about splitting, but you got to think about all the reasons you are with him and see how it weighs out (sorry for the drug ref.), and remember the past doesn't count if the present is shit. I didn't see how old you were but I am sure you have plenty of time to find the perfect match. He might be "The One", but at the moment it seems like he is forcing himself to be "The One". . .

Just take a "break" and spend alot of time with friends. . .