The implication is that time is precious because you have so little of it. If lifespans were ten thousand years, you could afford slacking a bit, just like if you have one billion dollars in your account, you can afford wasting some of it.

That said, I agree with you that it shouldn't matter. But it does.