I have only a vague memory of the time of the Churban, but it was pretty bad.
Actually, the Gemara is somewhat surprising when it says that they were Tzadikim. We know that there were numerous factions, many of whom were real Apikorsim. Seemingly, they don’t matter.