Depending on where in LaJolla the ES is (I'm not sure) I have to agree with pp, the traffic is NASTY. Both traveling around LaJolla and getting around from LaJolla to other areas. While the area is beautiful, I personally think you'd waste alot of time driving around.
You didn't mention what you wanted to do while you were there, but of the two options, I'd say the Seaport villiage one would be your best bet.