MP,
You’re talking about a very wonderful ideal – that everyone had the tools to overcome the yetzer horah, and always utilized them, without any external help. We don’t live in such a world, though.
If we did, we could leave our doors unlocked at night.
If we did, Chaza”l would never have had to institute any gezeiros.
If we did, we wouldn’t daven “al t’vieinu lidei nisayon” because we would relish the challenge.
Rather, we are supposed to dread sin and distance ourselves as much as possible, especially as it pertains to these specific desires.