The Pop Warner concerns are valid. For every person who has had "no issue" with them, you can probably find two or three more people that have gripes about them.
That being said, if you must be there the same time as them, going at the end of their stay bodes well for you. As teams are eliminated from the tournament, families go home or leave the resort. So it starts to thin out. In addition, staying at AOA means you'll likely avoid them. To date, they have not yet stayed at AOA and I doubt they would since its still relatively new and popular. I would stay at AOA regardless, since it's a roll of the dice on which moderates they will be at.