I think it depends on what's more important, food or character interaction.
We've done breakfast at Tusker House and loved the food. It was really, really good! The characters went by so quickly. They barely spent any time with us at all.
We've done breakfast at Chef Mickey and liked the food (not as good as Tusker House, but still good). The character interaction was much better.
We just did dinner there this past Saturday night and the character interaction was incredible. The food was good enough, not incredible, but good. We had an 8:20pm reservation. I was afraid that it was too late, food would be bad and characters would be rushed. I was SO wrong! The characters were amazing with my DD and 4 yr old niece. They spent so much time doing pictures and interacting with them. Then, as the restaurant started to empty out, they came around a 2nd time and danced and played with the girls. They were in heaven. Seriously the best meal of our trip because of the characters. They really gave my DD a chance to warm up to them and then she loved them. CM is now a must do for us.