We’ve had family members/friends invite themselves onto our trips before. Normally for us in the end they don’t get to go but occasionally they do. We always are just honest with them that they can come if they want to but we will not change any plans to fit their needs. Even if those plans are we want to go ride pirates right now and they want to go ride splash mountain we go “ok have fun at splash mountain we will meet you at The castle when we are done”. We will also sometimes say we will spend so many days with them but other days really are “just us” days and we let them know in advance what days those are. If that’s the route we go we do take into consideration what they want to do as well to a point. If we’re at Disneyland and they want to go spend the day at a beach - sorry but no - but if they want to ride splash mountain at a certain time or go eat at a place we didn’t have listed for the day we will go along with them.
We are kind of the more the merrier and really enjoy having family along for Disneyland (but not for all vacations...some we just want it to be us so we can decide what we do every day without anyone else complaining). Our next trip we have FIL and MIL coming, and BIL and SIL and nephew. It's becoming a tradition and it's so nice to have extra help with our kids, too. But we have a relationship where we like to do most things together.
then nix the last part. Best to be up front with people, is my motto. To me, it’s rude he invited himself along or even suggested it, so if it seems rude to say you don’t want him to, oh well.