Your argument would have just as compelling before Torah shebaal peh was ever written, and I’m sure the tzedokim and such used it (not ch”v to put you in their camp).
Torah shebaal peh didn’t disappear. It was always dangerous, and continues to be so.
????? ???? ?’ ?????? ???? ?? ?????? ????? ??
So be careful who you trust.