I see people's grammar and vocabulary as more of a statement of their level of education than their native intelligence, really. There are plenty of very smart people who don't have much formal educational training. Just as there are some really dumb ones who do. I think many of us probably do judge people's intelligence based on superficial things like grammar, spelling and vocabulary, but I'm not at all sure that's a fair judgment to make.