Well (depending what time of day it is) you could be going towards the sun so maybe it would count as up.

As the northen part of the hemasphere was populated first people would have got use to calling north 'up' so when they ventured south it would be down.