While I agree with you, that's not really an explanation. For example, we discuss the universe in terms of things being light years apart. That means, say you saw a star explode that was 100 light years away. That means, if you are seeing it now, it happened back when people were driving around in Model Ts. And, 100 light years is a relatively close distance. The thing that will ultimately doom the planet could very well have already happened and we just haven't seen it yet because even the light from that event has not gotten here yet.
So yes, infinite, but I don't pretend to understand it, let alone explain it.