Joseph,
There is a famous story with the Chafetz Chaim. A chassidishe rebbe (forgot who, very famous) was going to be in town for Shabbos and asked to stay by the CC, but he said that he’d appreciate if the men and women ate separately. The CC wrote back that he is more than welcome to come, but in his house the family eats together on Shabbos.