The town of New Paltz is interesting, and the Mohonk Mountain House is near New Paltz. You can go and hike the grounds as a day visitor (you will not be allowed inside the Mountain House itself, but the grounds have lots of great hiking trails).
You can actually get reservations for breakfast or lunch. It's worth the price as then you will be able to drive up to the parking lot in back of the Mountain House and walk around the Mountain House & Lake. Otherwise, the hike UP to the Mountain House, and back down, is about 4 miles each way. It's a beautiful walk, but it is STEEP.
There are lots of beautiful waterfalls, mountains and places to visit
west of the Hudson River. It IS the Catskill Mountains.

There is Minnewaska State Park. The waterfall at Lake Awosting is in a commercial on TV now. I forget the product the commercial is for, as I'm always looking at the waterfall. I think it's a granola bar. (This waterfall should not to be confused with High Falls, NY, which also has great falls.)
There's Hunter Mountain in the winter for skiing.
Woodstock is an interesting little town.
So is Rhinebeck. Many celebrities live up there, also in Cold Spring & Pawling.
Samuel's Sweet Shop in Rhinebeck is owned by Jeffrey Dean Morgan & wife, Hilarie Burton, with Paul Rudd & wife, Julie.
Rt 9 in Poughkeepsie and Wappingers Falls is where the main shopping malls are. Kingston has shopping malls too.
Bash Bish Falls State Park is near the intersection where the borders of the three states: NY, CT & MA meet.
In the Fall, one can take a leisurely scenic boat ride up the Hudson from NYC to just below the Mid-Hudson Bridge in Poughkeepsie and back down. There are other boat rides along the Hudson.