Think of the bachelors we had in klal yisroel: Rabbi Yaakov Weinberg, the Sridei Esh, the alter mirrers, and most gedolim were either divorced or widowed for a significant part of their life and so on.
The Sridei Eish was divorced. I know of no gedolim who never got married and precious few who were divorced.