I am just about the biggest "ride weenie" in the world, and although I was startled by the drop the first time that I did PotC, it has never prevented me from riding it again and again on future visits. It doesn't bother me a bit.
I can't believe the photo that is shown above (Well, I DO believe, but I it is HARD for me to believe - YOU know...) I would have estimated the drop at three or four feet.