I've never stayed at POR but I've stayed at the Poly, the CR, and AKL. Was at AKL in Jan. Thought it was fabulous. We had giraffes and ankole cattle and kudu outside our balcony. The pool is terrific with zero entry and a slide. We enjoyed chatting with the many African CMs who work at the resort. We enjoyed the art and cultural displays. It is definitely a distinctive environment. It may be the least "mickey mouse" of all the resorts. This place packs a WOW factor beyond Disney. (My opinion.)
The things you will like moving up from a moderate to a deluxe are interior walkways, balconies, more eating options, and a bigger room with bigger beds. I liked the dedicated bus service to all the parks and DTD; we never shared with another resort when I was there.
The only thing to consider is construction. Some people say they notice a great deal and others report they never heard a peep. So there you go.