MP,
Nice theory, but contrary to Chaza”l.
There are also serious inconsistencies in your analogy.
Moving out, while indicating that the thieves won, does not in any way mean that the yetzer horah won. Avoiding nisayon is a tool which the Ribono Shel Olam gave us and demands that we use whenever possible.
Building a fence, we agree, is not ideal, but can be helpful.
Learning to defend yourself is great, but you somehow forgot to mention that the thieves may win, and you’ll be dead.
You also misunderstand the position that self control is insufficient. That point of view (which is Chazal”s) in no way diminishes the need for self control; it merely mandates complimenting it with whatever other means are possible.