this is the Castle you are referrring too?
stayed here inthe late 2002-2004/5 it was pretty good I loved going up to the top floor on the terraces at night on the terrace to the left closest to WDW you could watch the high fireworks from the parks even during the day you could see over tot he parks aliabet it was a distance
its probably 20 minutes by car depending on traffic