Seneca said this quote

There are more things, Lucilius, likely to frighten us than there are to crush us; we suffer more often in imagination than in reality.