I think it depends on where you spend your time and what parks you like to go to and in some ways how old your kids are.
We like the Poly because we can get to Epcot/Broadwalk area efficiently.
Also my family are big health fiends, exercise at all hours...so at the Poly you have access to the GF spa and you have a beautilful walking path along the lagoon from the TTC, through the Poly, along the beaches to the GF and back. Our kids are older, so they go to parks on their own and the ease of the transportation from the Poly, TTC or MK gives me peace of mind that they can get where they want to go and to get back easily. We love the conveince of the monorail...actually we're spoiled by it.
The AKL is beautiful. Yes it is a little longer to get to MK, but it takes longer to get to AKL from the Poly. I think there are more kids activities at the AKL and they are cultural based. The guides from different countries are so enthusiastic. I think if your kids are old enough to appreciate the culture and the diversity offered at AKL, then I would stay at AKL.
Now that's from someone who loves the Poly. But I'm all for giving young children the opportunity to experience something very new and unfamiliar in a comfortable environment.