We have a 4 year old DD. IMO, the walk was not too bad unless you need to run back and forth for drink refills and food. Being away from the Tower made us feel more secluded. Depends on your preference and others might think differently.
Since Garden rooms do not have a balcony, we like the ground floor with the patio. For the Garden view rooms, we like the end of the wing facing the bay. Beautiful sunrise in the morning, view of the bay, and great viewing of the EWP at night. Downside is the longer walk to the Tower and if you do not want to see EWP, you are still going to hear it!!!
Hope this helps.