gopherit - I don't believe it has to be on ESPN to be televised at the ESPN Club, they have a satellite and show games from all over the country, whether on ESPN or local affiliates.
The only exception is if there are blackouts in effect. For example, one Sunday the Jacksonville Jaguars game was not able to be televised b/c the Jags hadn't sold out their game so they black it out on TV in the hopes that people will come down to see it. The same thing happens sometimes in the NYC metro area, if the Mets are playing the Braves and it's broadcast on both the Mets home station and TBS (which shows Braves games), they'll black out TBS to show it on the Mets affiliate.
This is the way it works during football season at least, I'm not 100% positive about off-peak times.
For the OP's question, unless there's a big game on, you shouldn't have a problem getting a table.