Friedrich Nietzsche said this quote

One is punished most for one’s virtues.