While the topic is Pommes Frites... do you think they would let me get a couple orders as take-out? Or does another restaurant serve them? My kids probably wouldn't like the adult menu so it isn't worth taking the whole family in for a meal.
You can get them at Red Rose Tavern. They serve the SAME fries with the parmesan, garlic, herbs there as the side dish for all the burgers. Just no remoulade sauce.

As DLgal said, you can get the Pommes Frites at the Red Rose Tavern as a side to some of the dishes. I found they were a little more hit or miss about the distribution of the cheese and garlic compared to Cafe Orleans, but that's probably a minor issue. It's a good alternative if you don't want to eat at Cafe Orleans.
Let's just reality check for a moment and you might feel better: this isn't supposed to be a French Restaurant. It's New Orleans inspired so everything is supposed to be off from "French" somewhat. (Unfortunately that has led to the demolition of my crepes but I've already stated my gripe on that one!)