Philip Larkin said this quote

I'm terrified of the thought of time passing (or whatever is meant by that phrase) whether I 'do' anything or not. In a way I may believe, deep down, that doing nothing acts as a brake on 'time's - it doesn't of course. It merely adds the torment of having done nothing, when the time comes when it really doesn't matter if you've done anything or not.