Elizabeth Gaskell said this quote

I believe that this suffering, which Miss Hale says is impressed on the countenances of the people of Milton, is but the natural punishment of dishonestly-enjoyed pleasure, at some former period of their lives. I do not look on self-indulgent, sensual people as worthy of my hatred; I simply look upon them with contempt for their poorness of character.