There are several reviews of V&A on the restaurants board. I have been there five times, twice in the regular dining room and three times at the Chef's Table. I am always willing to return. I am even willing to put on real shoes.
I have never been particularly thrilled with the castle. It is a nice location, but crowded and noisy. The food is decent, but nothing to write home about.