I think it is safe to say that a woman will have a difficult time understanding what goes through the mind of a man, while a man will have a tough time trying to understand what it is that makes women want to dress a certain way.
(I hate using the term tzniyus as a verb, but it seems such a common usage I will use it for my point) Acting tsniyusdikly can also be attracting, as evidenced by the chazal that Boaz “noticed” rus. It isnt necessarily the “attracting” part that is in poor taste (one can make a positive impression too), it is what one does to attract the attention that can be problematic.