We usually stay at the deluxes as well, but stayed with a school group at the All-Stars this June/July.
I was pleasantly surprised. This resort, while definitely a budget resort, is still filled with Disney music. We stayed at All-Star Music, in the Broadway section. The rooms are small - but ours, at least, was clean and comfortable for two - we usually stay with our family of five in one room at the CR, or a deluxe room at AKL. These rooms would definitely be crowded with 4, unless 2 were little ones.
The bus service was great - never waited more than 5-10 minutes for a bus, and the bus rides were fine - we got a couple of funny drivers - it was my daughter's birthday, and one driver had us singing songs, including "Happy Birthday", and he gave her a Disney "Honorary Bus Driver's License".
The food courts were busy, but lots of selections. Our rooms were not noisy, but I can see how the preferred rooms in the Calypso section facing the pool might be. The pool was very crowded most of the time. Our kids chose to swim in the "quiet" pool nearer to our room.