Just like a soldier in the army has to wear his uniform at all times when he is on duty or else he will get court marshaled,
So too yungerliet and rabbeim who are on duty 24/7- 365 should have to wear their hats and jackets whenever they step out into the street.
What about the Nazis? They wore uniforms. Are you saying that we should be like the Nazis?