Ambrose Bierce said this quote

Abstainer: a weak man who yields to the temptation of denying himself a pleasure.