Oscar Wilde said this quote

But then one regrets the loss even of one's worst habits. Perhaps one regrets them the most. They are such an essential part of one's personality.