And indeed, folks who feel that way are well-served by not getting the Dining Plan. By the same token, I think in many cases Disney will allow you to treat your young child as an older child, and will charge you full price for admission and the Dining Plan. If your concerns about what your young child eats are very significant, then you have that option, and shouldn't have a problem paying what extra amount it would cost.The main problem I always had with it was forcing everyone in the room to be on a meal plan, then the only choice for children is processed, high fat, high sodium junk.
Alternatively, you can just look at the cost of the young child Dining Plan as a total loss, and evaluate the Dining Plan based on having these useless credits, and paying in cash for everything you get for your young child. Even figuring we're never going to order any appetizers nor any desserts, we're still going to be saving about $6 per person per day in January. [Here are my computations.] That means if we had two young children with us, and planned not to use any of their credits at all, we would still save a little money on the Dining Plan. And all the appetizers and desserts we do order (some of which could actually end up constituting the young child's meals!), and all the snacks we get using the young child's credits -- that's all gravy.
The point is that you have choices, including deciding the Dining Plan, while good for some, is simply not good for you.