Thomas Fuller said this quote

The devil gets up to the belfry by the vicar's skirts.