” You won’t see them at a Siym Ha Shas or any other asifah where all b’nai Torah/ G’dolai Torah.”
For the record, Agudas Yisroel hardly makes up “all the gedolei hatorah” and in fact many gedolim were and are opposed to the Agudah since its inception for a variety of reasons. If they were represented by foolish chutzpadig people like you they would be saying it is you and your ilk that are chutz l’machaneh.
What does it matter if people attend your events or follow your hashkafos? Are you that self conscious that if people object to something you believe in it is the end of the world for you or you are forced to write them off?
Quit being a machriv riv. The Lubavitcher Rebbe’s statements were and are well known and despite that he enjoyed the support of many. If you want a comment on his character I suggest you look at what Reb Moshe addresses him as in his letters to him.