You need a reservation. It’s a very small restaurant with few tables and a small counter. Some, but not all, ice cream dishes are available for takeout. You can, of course, try a walk-up but it’s far from guaranteed given the popularity and limited seating.