You are not crazy, but just be very flexible. Personally, I don't like to wait too long to eat and don't like to scramble to find a restaurant that has availability. If you eat at off hours, the waits may not be too long. You are also going at a pretty busy time, the tail end of spring break season and early Easter season. You could book some PS's and cancel if you don't want them. That way you have them as a fall back.
Or if winging it is your speed, go for it! Many people do and like the spontaniety.