Just because we know it doesn’t mean that the yeshivos will expose the bachurim to anything other than learning. It goes against the idea of the yeshiva being a fortress against outside influences.
Why stop there? why not go on to smoking, the internet, drinking, Noshim etc.? The yeshivos (perhaps rightly) feel that the one (or more) child who is not exposed should not be exposed by the yeshiva.