I loved the POR resort, although we had only stayed at value resorts before then. I loved the ambiance, the landscaping, the restaurant and bar, the smaller and quieter pools, food court. I found the buses were very good. We found a shortcut from our room to the bus stop, about 2 minutes, and never had long waits for buses. Maybe it's just me, but I never found transportation to be a problem at Disney, whether at POR or an All Stars. If you stay at POR to save money, perhaps you can splurge on a couple of special meals like CA Grill or V&A's. I guess for me, it's always a financial decision, where I can't justify the high cost of a room.
Of course you will have a magical stay whatever you choose.