Let us not think that we lack the kedusha they have. The opposite is usually true.
The Chazon Ish points out that excessive effort to avoid something will lead to the exact same effect as excessive indulgence. Overly avoiding such things leads to obsessive thinking about them, not the reverse. Therefore he says we must not be smarter than the Torah, and realize that the Torah has prescribed for us the perfect middle ground.