You can't see the fireworks from inside Crystal Palace. You are able to see the castle from right in front of the restaurant, but I don't know how crowded it get before the fireworks.
We stood at the windows in the back corner of the restaurant (windows facing castle) and could see them beautifully when we were there. It was great! Not too packed, either.