There are plenty of good restaurants in downtown Orlando that are perfectly safe enjoy. A few off the top of my mind, Dexters of Thorton Park, Nick's Italian Kitchen are both in Thorton Park, which is a nice area of downtown.
Here's a site that may be helpful:
http://www.downtownorlando.com/life/dining
I'd also recommend taking a short drive north of downtown to Winter Park and the Park Ave. area. Plenty of great restaurants/shopping there that you may be able to make at least a 1/2 day of.
Let me know if you're interested.