I always thought I would prefer the mansion buildings as well, but I managed a few strolls through POR while staying at POFQ, and I was surprised at how much more appealing I found the Alligator Bayou section than I thought I would.
As per distances, the bridges connect everything together really well, so I think most rooms are fairly close to the main areas.
More so than curb appeal, I'd be concerned about the lack of elevators in the Alligator Bayou section, so when I stay at POR my first request will be ground floor or close to elevator.
I'd much rather walk an extra 100 yards pushing a child in a stroller than have to carry both the child and the stroller up a flight of stairs.