DY, ask him if you can be exempt as when you are in the sukka you are thinking of his attitude and that makes you mitztaer. Ask him also how a Chassid can be mitztaer when he is supposed to always be b’simcha.
Abba, this is his exact wording:
? ?? ?????? ????? ?? ????? ????? ????? ??? ???? ????? ??????? ??? ??????
?? ??? ????? ???? ?? ?????? ???? ???? ?????? ?? ???? ????? ????? ???
???? ???? ????? ?????
??? ?????? ????? ??? ????? ????? ????? ???? ????? ??? ????? ?????
?????? ?? ????? ???? ????????
??? ?????? ??? ?????? ???? ?????? ????? ????? ????? ??? ???? ?????? ????? ????
????? ???? ?? ??? ???? ???? ???? ?????? ??? ??? ??? ????? ???? ????
??? ??”? ???? ???? ?? ?????? ???? ????? ??? ???? ????? ???? ???? ???? ?????
??? ??? ??? ???? ??????? ??? ??? ???????.
??? ?? ?????? ??? ???? ??? ??? ???? ?? ??? ????? ???? ?????? ????
??????.
It comes out that he does not explicitly say to wear them, only that that was the custom in his area. Rabbi Menachem Posner, the Staff Editor of chabad.org says that their minhag is not to wear them on Chol HaMoed. You can ask him about it yourself.