We'd choose Poly CL hands down but that would be for our family size (2 adults, 1 child). I don't think I could stay in a room with four adults and a child, no matter how close we are. But, having access to the CL lounge could help reduce the "crowded" feeling a little bit.
We enjoyed our POR stay but it doesn't compare to Poly for us. We also really enjoy CL. We like having access to the snacks/drinks throughout the day. Beer and wine is available from noon onward and that's a big plus for us. The breakfast options at CL (fruit, toast, oatmeal, coffee, yogurt) also match our usual morning meal preferences, so that was another bonus. We didn't have to go far to eat either!
We've never done
free dining, or any dining plan, because we don't eat the way the plan is designed, so it doesn't make sense for us.
We also think the Poly location is far superior to POR. My DH does not like having to rely on buses so that's a negative for us.
Ultimately I think you should choose what makes the most sense for your traveling group.