Sounds like you had an unfortunate group staying there with you, but can you blame the resort? When we stayed there for the marathon, when the half got cancelled there were runners running the grounds and others cheering, but the resort gets no credit or blame for that.
I have read many reviews, but have not experienced it myself, that have described similar behavior that you are when people stayed at the all stars, so I think it's sort of a luck of the draw things especially when staying at the values.