The Copper Beach Inn is pretty pricey I think. Or maybe it is because I live near it & the toursits stay there during leaf peeping season so I avoid it. I am not sure about the Ivoryton Inn (I drive by both a few times a week when I go out to the store).
There are a bunch of Inn's here too, here is a link:
http://www.bedandbreakfast.com/connecticut.html
There is a small B&B in my town & it is right on Main Street & probably about a 2 mile walk to the CT River from there (if that).
If you are looking at hotels vs Inn's and you are looking at the lower CT river valley, don't stay at the Comfort Inn in Old Saybrook. I don't hear too many good things about that place but I have never stayed there so it is all here say. There is a Super 8 on the other side of that town (close to Westbrook) & it looks fairly clean & was built in the past 5 years.
I would look at hotels in the Mystic area if you are headed to this side of the state.
Two nicer hotels are the Saybrook Pointe Inn (I think that's it's name) & Spa & Watersedge (Old Saybrook & Westbrook they are in).
Mystic Aquarium is very expensive IMO. We were members but I didn't renew this past March. My kids enjoyed it but for me, we got there at 9 & were done by noon.
What is cheaper is Mystic Seaport & museum. And when you go to down town Mystic it is very quaint & I would walk it again if I didn't have my kids to nag me "I want this.."
Here are these cute little toursity maps. You can pick them up at many places in the area.
http://www.lighthousemaps.com/index.html
Here is the Lenny & Joe's Menu BTW (not that I frequent there or anything

but we do get the GC in December when they are 20% off).
http://ljfishtale.com/
There is also Johnny Ad's in Old Saybrook which is pretty good too. I think it is greasier. I only eat the lobster rolls at both places.
There is also another seafood place that was on the Food Network a few years ago in Niantic (?) I think. I never ate there but it is on the water.
The Essex Steam Train & Riverboat are also pricey. We only go on our free weekend (being local) & for the Santa train. But you can go there & watch the trains leave/come in & walk thru the Gift Shop & the area out back that has the train set up & a few other things (nothing great, my kids only like to go in there & play with the trains).
Another free thing is to go & walk the town centers. Essex is really nice & you walk to the water area. There is an Inn there too (I think) plus some cute stores. By the water is the CT river museum (never been).
Deep River is up & coming & Chester is blink & you will miss it! My friend shops at the bead shop there.
There is also a ferry in Chester Ferry which takes you over to the bottom of Gillettes Castle. I think it is like $4 or $5 to cross it with your car. BTW, the Castle is pretty neat if you take the tour. William Gilette was a smart cookie back in his day.
Old Saybrooks town center/Main Street is a bit longer/bigger then the above 3.
You can go & sit at the Old Saybrook Docks & watch the boats come in & out of the mouth of the CT River into the sound.
You can go hiking at Chatfield Hollow in Kilingworth.
How about Letterboxing? That is free & it will get you to see some sights off the beaten path.
Don't let my dh read this but it is pretty nice on this side of the state (I am between New Haven & I border the CT river). I am from Fairfield County & I do miss living there but it is quiet & peaceful here. But I would
never tell him that!
I haven't been here yet but maybe some day
http://www.creamerybrookbison.net/index.html
You say you are coming in July. If you come the 3rd weekend (I think), avoid Deep River center/Devitts Field (I was just there)/Main Street because the Deep River Ancient Muster will be going on. It is the largest one in the world (I think the world). I have never been but if it is a cool night & we have our windows open we can here the music. We are usually picking blueberrys when the parade is on.
Oh yeah you can go & pick local fruits. We go to Scotts in Deep River in July & pick blueberry's.
I think Old Lyme has some old place you can tour & it is by a B&B/Inn. There is also a board walk on their beach (one of them) as there is on Hammanasette.
Spa? The Norwich Spa is supposed to be nice (never been).
There are 2 covered bridges. One is around Haddam/East Haddam & the other is in Litchfield County.
Lymans Orchard is another place (it has a web site) and there is a farm like that in Guilford too, but the name is not in my brain right now.
OK I blabbed enough. I could go on but I won't!