That's exactly what was supposed to happen, but COVID ruined it

The logistics of bringing any more actors than necessary up to Vancouver and having them quarantine for two weeks just to film one scene just wasn't going to work. I'm sure they couldn't afford it either, after paying for all of the COVID precautions and quarantines for the cast and crew.