I wasn’t addressing the details of the issue in this post, i was wondering why people feel this way – you explained it quite well, that the “creepy” factor is because per force, the man addressing them must have taken notice of the way they are dressed.
I can see that very clearly if the statement was made in person, but for a man to air his grievances on a forum doesn’t imply that he is noticing the way you or any individual dresses. There are gechidei segulah who never notice anything about women, like the boss you mentioned, but for the vast majority of ehrliche men, there is a huge nisayon for shmiras aynayim which is made a thousand fold worse by the “personal” decisions women make.