I'm in the boat with most others. If I booked a category, I would certainly be frustrated. But, it depends on the situation. For example, I tend to book Garden or Water at the Moderates (and walk from the main building) to get that feeling of separation. Switching to a view of the parking lot ruins that for me, but I would likely be ok with the refund and some type of gesture (like FP or the like).
If I booked a "premium" view - like CR tower, WL courtyard, AKL Savannah, etc., that would be different. That would be a huge splurge, and I would expect something significant if it happened. Because I would have likely stayed at a Moderate instead.