Unless you are planning to park the infant under the table, or keep the infant in someone's lap during the entire meal.
You need a space where you can either park a carrier or for them to remove a chair for a stroller. You cannot block an aisle or even the space between tables.