Mom2Four - Welcome! You have a great dilemma! The choice between the Poly and AKL is hard for me to make, too, so last trip, we didn't! We split between the two!

We only stayed for four days total, split down the middle with 2 at the Poly and 2 at AKL.
We love both these resorts, and it is so hard to choose. The Poly has the monorail access to MK and Epcot, the beautiful beach and castle view, the wonderful island atmosphere, that great volcano pool. The music, tiki torches at night, all those wonderful paths through the lush landscaping, it's easy to forget you're in FL!

On the other hand, AKL is very exotic, the lobby smells wonderful (like cardamom and fire,very subtle) there are lots of viewing areas for the animals and savanna guides to answer your questions. You can book a room to overlook a savanna, and have a view of the animals day and night. The restaurants Boma and Jiko are very good. The atmosphere is very calming, relaxing.
I'll have to agree with the previous posters, if you're main focus is going to be MK, and/or you have small children, go with the Poly for convenience. If your children are older, and transportation is not as much of an issue, go with AKL. Or, do as I do, and split between the two for the best of both worlds!
(HillPete, that probably won't work as well for you, with children that young, I'd probably go with the monorail resort!

)