If wetting a fabric is assur- how about drying hands on a towel?
That’s muttar. If you want to be machmir, you can first shake off the excess water from your hands, but the minhag is to be meikil.
http://hebrewbooks.org/pdfpager.aspx?req=14171&st=&pgnum=179