Well only giving a 30 hour game 1 hour chance to prove itself is not really fair IMO. Majora's Mask is a pain at first because nothings unlocked you have this time limit till the end of the world occurs, this odd save system to learn, and you're a frickin Deku scrub...Starting off just kinda sucks. But as you learn the reverse song of time and get through the first dungeon, and build up a few masks the game becomes exponentially better. Mainly because you have more tools to manage your time better, the idea of having to reset the clock becomes less and less of a "horrible" thing to do as within a couple minutes of play you can be right back where you left off, but with days of time ahead of you instead of minutes.

Really if you have some spare time I'd really suggest getting a rom of the game if you don't have it anymore and give it another chance.

As far as ranking the Zelda games that I've played.

OoTMQ > OoT = MM > LoZ > Twilight Princess > Wind Waker > LttP > LA > AoL