That photo doesn't necessarily do justice to the dangers since it doesn't show the shore. There's no beach there right at Fort Point. The shoreline is all jagged concrete infill. It's there to prevent erosion.
I've seen some pretty crazy surfing too, like people surfing next to our condo rental in Kona, where the shore was all jagged volcanic rock.