Health, now I understand what happened — you followed the words of the Chochmas Odom which follow the pashtus of the words of the Rambam. We, however, do not go like this le’Halocha. Look in Kesef Mishna on that Rambam.
If did pasken like this, we would have a big problem as almost everything we wear originally came from the Goyim.