“When a man is called up to the Torah, he is supposed to touch the Torah only with his Talis, not with his bare hand.”
I am well aware of this. However, Pashuteh Yid’s question refers to Hagbah and Glilah, when the Torah is already wrapped up and a person catching it would touch only the velvet covering and not the actual parchment.