You should definitely plan to eat at
Lynn's Paradise Cafe (
http://www.lynnsparadisecafe.com/ ). You can really wear pajamas to breakfast (not that I would, but some people do). It's just a really quirky little place that is nationally renowned.
Spring racing ends the first week of July, so going to Churchill Downs for the races may be out, but the
Kentucky Derby Museum is nice (
http://www.derbymuseum.org/ ).
If you decide to visit "
My Old Kentucky home". set aside a few hours to visit
Bernheim Forest (
http://www.bernheim.org/). They are in the same general area (if you take I-65 to Bardstown, you'll drive past Bernheim.
Heaven Hill and Jim Beam distilleries are in the same area. (
http://www.bourbonheritagecenter.com/)
(
http://www.jimbeam.com/our-bourbon/visit-the-distillery)
Take a tour of
Louisville Stoneware (
http://louisvillestoneware.com/). You'll probably want to buy something, too.
You can take a
walking tour of Old Louisville. There are excellent examples of Victorian homes. Too beautiful to describe. Of course, not all are refurbished, so some not so beautiful examples, too. (
http://www.oldlouisville.com/walking_tours_of_old_louisville.htm)
Houses not your thing? Try a
ghost tour (
http://louisvilleghosttours.com/)
Twenty minutes from downtown is
Caesars casino (
http://www.horseshoe-indiana.com/casinos/caesars-indiana/hotel-casino/property-home.shtml)
Louisville Zoo (
http://www.louisvillezoo.org/). We go here a lot.
There's also the
Louisville Science Center, the
Rauch Planetarium (love it!), the
J B Speed art museum, the
Louisville Slugger museum, and the
Frazier International History museum (they all have websites you can google).
Just under an hour away is
Taylorsville Lake State Park ((
http://parks.ky.gov/findparks/recparks/tl/). Boat rentals, walking trails, etc. Lots of wildlife viewing (esp after dark-you can see hundreds of deer gathered on the main road).
Fourth street Live in downtown Louisville (
http://www.4thstlive.com/)
I tried to keep things within an hour or so of downtown.
As others have mentioned, further out, there's Mammoth Cave, Kentucky Down Under, Kentucky Horse park, Red River Gorge (with Natural Bridge), Lincolns Birthplace, Pleasant Hill (Shaker Village).... Well, the list goes on and on.
There are things to see/do here. You just have to hunt them out. Louisville is not a tourist destination, so very few things will be "in your face". I think that's why people who come here don't like it. They don't see anything to do, when in actuality, there's a lot to do.
I really hope you enjoy your visit.