We stay at POP so I will never again go the week of Pop Warner. Went last year and...well, like I said, never again.
However, if you are staying at a deluxe or, I think, CSR, you should be fine. You do see the kids in the parks but they don't really make much of a difference unless you're unlucky enough to get stuck in a room with one of the obnoxious groups. Certainly not all of the kids are obnoxious, in fact they are probably a minority, but one time stuck in the stretching room at HM with 15 continuously screaming, cheering, giggling cheerleaders is more than enough.
So bar an unlucky episode like that, which can really happen with any larger group of giddy people, you'll be fine. I would only be wary if staying at a value or one of the mods that the group stays in.