We have always used the tables around the pool areas (lap pools at both) and never had a problem with security. We never ventured back into the grotto area.
At Swan, there are interior courtyard areas that are fitted with tables, sofas, chairs, etc. and are open to use as well. I know during the early stages of the Covid reopening, the one closest to Il Mulino was utilized for outdoor dining--not sure if that is still the case. That area is pictured here:
View attachment 589392
The door to Il Mulino is behind the Swan fountain on the right--this enters the bar area. The second courtyard is entered across the hall from this one and that door is out of frame to the left.
We have always enjoyed these areas although they are not covered in the event of rain.
We have also wandered over to the Boardwalk and grabbed a bench in front of Jelly Rolls. When it was open, the music from Jelly Rolls could be heard, but not overly loud and there was the view across the lake and Boardwalk area of YC/BC and BWI/BWV.