Sounds like you haven't found that guy you clicked with.

I wouldn't worry about it, I'm the same way as you. I don't let others get close to me unless they have a certain element about them. The guys you been meeting simply don't have it!