Maybe you can try to be the one “in control” of the situation. If you see a frum man coming towards you on a path take a step to the side to give extra room. You actually might get part of the schar for the zehirus.
In terms of attitude, I know it’s insulting. I’ve felt it myself. Some men avert their eyes so completely, it’s almost like being invisible. My mother reinterpreted it for me saying” if you were a hundred year old unattractive woman they might behave differently, so take it as a compliment. That really helped me reframe it.