A Talmid Chacham (Torah scholar) must present himself in a respectful manner. The Talmud has harsh words for those who do not do so in the manner of dress.
In the present day world not having at least a basic secular education has the same effect as walking the streets with grease soiled clothing.