Friedrich Nietzsche said this quote

Not to he who is offensive to us are we most unfair but to he who does not concern us at all.