That’s false. The people who talk during davening do not claim interrupting davening is okay to do. The people who steal from the government do not claim stealing is okay to do. The people who cheat on exams do not claim cheating is okay to do.
They all know and will acknowledge if asked that cheating, stealing and interrupting is wrong.
The toeivaniks not only sin in private, they proudly parade about their sin. They create symbols like rainbows to advertise their sinning and promote it.
And if asked if that activity is wrongful and shouldn’t be done, virtually every one of them will tell you there’s nothing wrong with doing it.