This is a big discussion in our home right now.
Have lived in primary home 37 years - 5 bedrooms, 3 and half baths, formal living, formal dining, family room, sun room, nice yard. It is in a great area but a very high tax state. We have redone most of it over the years but kitchen is about due for second makeover.
We also have a seasonal home on a mountain lake a couple of states away. Not built to be a primary home (closets are smallish, not a lot of storage) but could be. Kids/grands love it but it is a long drive so usually only a week in summer for them. We are there a lot.
We tried a 2 br condo in Florida for 6 years thinking we might sell the primary in the high tax state and split time between the other two. Six years proved Florida would not work for us. Sold it.
DS just married and they live about an hour from us in lower tax state. They keep encouraging us to move near them....sending pictures of homes, etc. I love the area ...historic small town but adjacent to larger city. Home would likely be older, historic, smaller.
Easter weekend, we had a full house....all kids, spouses, grandkids - some for 2 nights, sone for the whole week. Playing in finished basement and backyard, making cookies and brunch casseroles. We loved it! Afterwards, I asked DH if having that experience once or twice a year is worth keeping this house and he answered a resounding YES. We are 67 and 70. Will revisit in a few years, I guess, unless one of us becomes unable to deal with steps. All BR upstairs and no easy way to change that.