I understand what you are saying, and I really don't think it has anything to do with morals. I am quite selfish with my time too. We have family that lives in Florida, and I don't get to see them very much. However, I don't get to Florida very often either, and I am spending a lot of money for this vacation. I don't have a lot of time, but have a lot of things I want to do. But, I've decided that I really need to spend some time with them. We are doing the Illuminations Cruise, and we invited them to join us. We are also going to have supper together beforehand. I have to eat anyway, so to invite them to join us, is not a big deal. I get to see them, but I am not giving up a lot of my Disney time.
Now, we have an aunt and uncle that live about three hours away from us. If it was just my husband and I going, I don't think I'd want to walk around the parks with them if it was my first trip. However, I still think I would try to fit in a supper with them. Maybe if you are going for the more romantic trip, and want nice, romantic meals, then maybe meet them for lunch. Maybe you could invite them to see the dinner show with you.
Maybe your BF would be willing to see your family and not his. What are his feelings?