I will always happily volunteer as a defender of both restaurants.

We have eaten at Coral Reef in 2001, 2004, 2007, and March of this year. We've eaten at Prime Time in 2001, 2006, and 2007. We're eating at BOTH on our May trip.
I enjoy the atmosphere at Coral Reef. It can be loud, but we try to sit on the first level, either against the glass or in the booths on that level. I also enjoy the food.
At Prime Time, I actually really like the food. The appetizers are good (at least the onion rings and shrimp are), I love the pot roast meal, and the shakes are great! We've never had overbearing waiters/waitresses, but we'd be fine if we did.
My consistent caveat to threads about restaurants that go unheralded by the DIS: try the places you want. We have favorites that aren't generally endorsed here, including Coral Reef, Teppan Edo (which we do every trip), and California Grill (it's given mixed reviews). We also enjoy/love ones that ARE loved - Yachtsman Steakhouse, Boma, etc. We experience them for ourselves. It's hard to ignore when a restaurant is dissed by the DIS, but we try.

Go and enjoy!