You can, and it's a great walk. We did it several times, and it's no more than a 15 minute walk (including time to exit the BWI and to navigate into the BC).
You basically just follow the boardwalk around the lake and then enter the BC/YC when you get there. From there you'll have no problem being pointed in the right direction to find Cape May.