You shouldn't have to. I'm like that. People may call it ignorance if you don't make an effort but what the hell. Why should you have to yak an talk about any old bullshit to be comfortable. Wouldn't you rather talk to someone about what YOU like and the person will understand you and like you for who you are, without getting bored.

Everyone's so hung up on this notion that we have some sort of obligation to change ourselves in order to become 'normal' in society.

Talk about what YOU want. Talk to who YOU want. And if it's meant to be, you'll click with people. Sorry if it seems like a rant but I don't think you should HAVE to create small talk. You either click with someone, or you don't.