I'm a HUGE fan of Rider Swap since I have an adventurous DD7 and DD2, we use the heck out of it. I'll throw another suggestion out there to cover your situations where someone may not want to ride an attraction that they are actually eligible for: DVC (Disney Vacation Club) Presentation
I know, sounds dumb, you didn't spend all this time planning and all this money to go sit in a presentation for a timeshare, but let me share my experience.
I recently went for a last-minute 2 day trip when I was in the area with my DW and 2DDs and still laid out a whole open-to-close gameplan. I didn't want to waist a second of my precious little time to hang out with a salesperson but it actually
saved me time. I scheduled this meeting around 6PM day1. They picked us up from MK (snuck us out by Magic Mountain employee lot) and had us back to that spot nary 1hour later. For my time I received a
$100 Disney Gift card (Elena dresses. Boom.) AND
3 USE WHENEVER Fastpasses PER GUEST (including my 2YO...). That meant I didn't have to schedule those Fastpasses. On Day 2, if we happened upon a ride or a meet and greet that had a 19,000 minute wait, we just walked up to the Fastpass CM and said we would like to use a whenever fastpass. Done. We made up the time we lost and then some the first time we used one of those passes.
In your situation, those could be your 'rider swap' Fast-passes so you don't have to pressure your non-riding family member. And while you wait, go blow your gift card on something THEY want
Note: you can still request Rider-Swap with the anytime fast passes in a situation where the non-rider is not tall enough etc. I seriously plan to schedule a DVC meeting every time I go back (I think there's a 1 per 6months limit fyi)