sounds like you're on the right path. I know that Faulkner mentions white houses a lot in his stories, usually to symbolize purity. This would also represent purity as in the white race, so yeah I could see why one might find the name The White House as prejudice or discriminatory.