Actually AI has had many "off" seasons, where all the contestants are just average.
Does anyone remember in Season 1 of AI, there was a constestant named RJ Helton. He was good looking and had a great voice, but according to Simon was no better than a boy bander. Evertime RJ tried to take Simon's criticsm to heart, Simon would berate him and berate him for no reason. Simon was so mean to him and this kid never said a bad word about Simon but took it like a man. I believe this is what Brian Dunkelman (the original co-host of AI) was referring to when he described the abuses on the show. I'll never forget how Simon abused and humiliated RJ Helton in Season 1.