Graham Greene said this quote

There are times when a lover longs to be also a father and a brother: he is jealous of the years he hasn't shared.