I'm definitely not an expert, we just returned from our first trip to Disney (well my first as an adult, I stayed at the Poly when I was 12 but have NO clue what building we were in!). We were on the third floor of the Tokelau building, on the east side (not overlooking the quiet pool). The view was fine, actually we were in the room so infrequently that we hardly ever looked outside. The one thing I didn't like in that building was that the slats on the balcony weren't spaced close enough together, so my 18 month old could have slipped out if she maneuvered herself just right. Turned out not to be a big issue since we hardly went out there. But in that building the second floor also has balconies. It was centrally located, took us two minutes to get to the bus stop or GCH or volcano pool. We walked back from the TTC once after returning from Epcot and it was maybe a 5 minute walk (we are fast walkers though).
I initially wanted the Samoa building, first floor, volcano pool side so that when the baby slept, whoever was in the room with her could at least be sitting outside while the other parent and older dd were in the pool. But they only had a second floor, which had no balcony, so we ended up in Tokelau.