Victor Hugo said this quote

He had to accept the fate of every newcomer to a small town where there are plenty of tongues that gossip and few minds that think.