Hi chinesefood.
To me, it makes more of a difference how other people respond to me. There are times I am off from work and wear jeans and a shirt and sneakers and baseball hat.
When I go into the same establishments dressed down, I may as well not be there. In fact, this past Chanukah, I dressed down and even got dirty looks in the bakery, which made me want to post this to you. Going to eat, mothers pull their kids back and keep an eye on me. Others cut in front, and it really is an entirely different experience depending on how I dress in a frum community.
When I wear my white shirt and black pants, I am called Rabbi by all and everything is good. People even want to know my name, where I live, who I know, my SS number, and everything about me.
So, while it may affect on me only a little by feeling like it’s a chilled out day, the bigger effect is how other people respond to me depending on how I dress. Which to me, is totally ridiculous.