I went for a few days March of last year! We had a great time!
We stayed at a hotel on the corner of Bourbon Street, did the Honey Island Swamp Tour, a city tour (which really was a pity party after Katrina for the most part, they're really exploiting those poor people in FEMA trailers, making sad photo ops out of them), an afternoon at Mardi Gras World (after riding the Canal Street ferry to Algiers) and a ghost walk - very cool.
Had a to die for breakfast at Brennans... Had cheeseburgers in paradise at Margaritaville.
The French Quarter and Garden District we found fairly safe to walk, even in the evening. Granted, we are 2 adults and don't have to worry about children.
Would for sure go back. HAVE FUN!