I don’t claim to understand mens taavos, but from conversations I have had with men about this topic this is what they told me:
No matter where you walk, there is always someone dressed really inappropriately (Ie shorts, tank top etc) so a Jewish woman with a skirt at her knee is NOT going to attract their attention, unless they are looking.
Now the mitzvah of tznius is a woman’s mitzvah. The side effect is that it helps men, but its not the prime reason. For example: if I have an infection and don’t feel well, I take antibiotics to clear the infection. The side effect is that I feel better, but its NOT the reason I took the antibiotics. I took it to clear the infection.
On a Jewish woman’s website, someone had asked why people wear skirts at or above their knees. The main answers were:
1) My rav allows skirts at the knee/mid knee
2) I gained some weight and my skirts don’t fit me 100% properly
3) Its really hard to find skirts that cover 100%
4) I know its wrong, but I struggle with it