My MIL lives in Mount Dora. It is a nice, kinda' "eclectic" town. While the flea market on the outskirts of town may/may not be "nasty", the downtown area is ripe with nice little shops of varying variety.
The Lakeside Inn is a nice place to stay and has a nice Champagne Brunch on Sundays.
They also have REAL train tours of the area lasting about 1/2 - 1 hour.
It's situated on Lake Dora and is one of the last "quiet" areas in that area of the state, although it's growing a lot in the surrounding areas.
It may or may not be your cup of tea, but it is definitely worthing investigating to find out.
Oh yeah, if you should see the Episcopal Church just east of the downtown area, that's where my DW & I got married!!