Am yisroel chai:
You seem as if that result bothers you.
It actually is the torah opinion, and even Rabeinu Gershom never suggested that there was somehow any issur of a man being mezaneh on his wife.
I don’t think we are expected always to understand every torah hashkafa fully, but it is useful to notice when our morality is not in touch with the torah.
I don’t really know why this result bothers you. It doesn’t bother me a whit. When a wife strays, it is far worse than when a husband does, since the relationship the wife has is supposed to be an exclusive relationship.