We just returned from our trip a few days ago, split stay at A0A and POR (we couldnt decide, are a family of 5, just like you!).
AoA makes a great first impression (great theming, awesome pool, fresh, clean, new), after a while it does feel very "value". Granted it was our first time to WDW so we had nothing to compare it to. We had two connecting LM rooms. The food was not the best and very non-traditional (macaroni cheese casserole square, not mac and cheese).
Pool was fun but very crowded. But, buses very convenient (one stop, one resort).
Then we transferred to POR AB room, requested Bldg 16 and wow, we were blown away at how beautiful the resort is - grounds, buildings,pool, river. It felt like we were in a Mark Twain novel. Very "Tom Sawyer". Room was bigger (compared to one LM room at AoA) and though we missed the 2nd bathroom, the overall feel and amenities of the resort made up for it. The fold down bunk bed is AWESOME! Kids took turns sleeping on it. Very comfy.
Food is much better at POR - better quality, better options. Kids' feedback: better mac and cheese, much better pizza!
We preferred the POR pool with water slide and shooting water. There's a cool play structure and fire pit near the pool so the kids swim, play, roast marshmallows, all within visible distance of my lounge chair.
POR also has the cool boat ride to DTD but we didnt care for DTD - crowded and not the best restaurants (not big fans of food at Rainforest, Planet HOllywood, etc). Boat ride was very fun, though. They also rent out the 4 seater bike things that you pedal - that was a lot of fun to ride around as a family. They have a very scenic bike path around the resort that straddles the river.
But, buses at POR have multiple stops. It's a big resort and has 4 different bus stops. More convenient at AoA.
I'm happy to give you more tips if you want to message me.
Overall - we would prefer POR but glad we at least tried AoA. Next time - split stay at POR/Beach Club!