As to the money part, you seem to have a really good financial outlook for yourself, which is wonderful! In this case, what I ask is, if God forbid something happened and taking the children were never to be, would you regret that more, or regret going on your own more? Only you can answer that question.
This question comes from a person that took her parents on a
Disney cruise, spent so very much money that was supposed to be shared with her idiot sibling that never has had enough to pay her back, and yet regrets not a penny. My Father passed away 6 weeks after our family cruise, a cruise filled with such joy for him and my mom, and whenever my memory recalls him sleeping on deck 4 in a comfy chair, with a contented smile on his face, any remembrance of how long it took to finally pay off that cruise fee falls away. So, what I am saying, from sappy old me, is that, if you have a good financial position, money is only money, but memories will last a lifetime.
Realizing, of course, that the above statement is often not approved by everyone! But we all have to make a decision that is best for our own life and heart, and I hope whatever decision you make, you find joy in it.