It wasnt just Chief Rabbi Goren, It was also Rav Elishev.
The issue came before Rav Moshe in a case where it seemed the local Rabbi was pressured to do the conversion and he refused to invalidate the conversion.
While not knowing he specifics of he Langers, In general in previous generations Rabbanim were loath to label people Mamzers even if there was evidence that they were