I always lift it. Its a bitch in my upstairs bathroom because sometimes the seat falls down halfway through and you get piss all over.

I also don't mind public toilets. I always wipe down the seats with a good wad of TP and then go about my business. If you get a thick enough wad, it doesn't touch your hand. I also always make sure to wash my hands afterwards.