I may be in the minority here, but I don't think it is worth a day trip to use the pool and beach. The pool at AKL is much nicer, so it will be a letdown when you see the one at VB.
Also, the beach is just OK, so save yourself the time and go to a closer one like Cocoa Beach. Better yet, go in the other direction to a gulf beach. They are much nicer.