Noticing differences in people does NOT make you a racist.
Maybe some people aren’t morning people. I am, but after 3PM don’t bother looking at me. I’m tired, cranky and hungry.
I notice differeces in the Chasidic sects such as dress (streimels), but this doesn’t make me a racist. People of the same color ARE different.
Just be polite and continue with “making” all the kiddushim HaShem that you can.