Okay.. so I thought i'd reply seeing as you seem very similar to us.
Poly was always our bucket list resort. Growing up, we'd marvel at it. We loved the theming and would stop by the lobby every trip. It's not that we couldn't afford it - I mean, we went to Disney every 3-4 years growing up, we just always stayed Value, off-site, or moderate. Forget Contemporary and GF, we'd pass through Poly and think "one day".
As my sister and I got older, going to Disney became easier. We started going for Christmas in 2009 and after I graduated and found a big-boy job in 2011, we paid for ourselves, so we were able to spring for a nicer resort or room (we'd each pay $2k for a trip, rather than my parents footing the bill). Each paying for our own portion allowed us to stay Beach Club (Poly was like $150-$200 more per night during Xmas). Still, we'd look for every excuse to stay Poly.
In 2017, that excuse would come. We were AP holders, so we had some room-only discounts. My cousin wanted to bring her two little ones and insisted on Poly. Who are we to argue? We stayed in a Standard View in the Aoteara building and were completely underwhelmed.
Don't get me wrong, it's a gorgeous resort. It's vintage Disney and had it been the first Deluxe we ever stayed at, we may have felt different. I think, too, that we had built it up so much in our own heads. It was that "bucket list" resort that would be the best place we ever stayed...and it fell short.
We didn't like that the buildings were separated, unlike other Deluxe Resorts that are all connected. I felt that for the price, it should have had its own fitness center (and an updated one, at that). The rooms were updated and spacious, but we didn't like that the sinks were in the bathroom, rather than separate from the shower. This made getting ready each morning difficult. So-and-so couldn't brush their teeth while the other person was in the shower. It also didn't feel like there was a lot of space to walk around. I love walking the Boardwalk area, but Poly felt constricted. Last, our room wasn't clean one day. At Beach Club, the service was so good. Poly made us feel as though it was our fault and that we "must have left the sign on the door". That was a big turn off.
Aside from that - It's Poly. It really is gorgeous and I'd never tell someone NOT to stay there. The point of this reply is to suggest that you temper your expectations. We built it up so much as our dreams resort and it suffered from that. Hiccups will happen and it won't be perfect. With that said, as PPs mentioned, don't spend rack rate. It's not an $800/night hotel.