Paul Valéry said this quote

What others think of us would be of little moment did it not, when known, so deeply tinge what we think of ourselves.