Ladino is very uncommon even among Sefardim. And even those that know it, it is their second language, not first like Yiddish.
During the asifa the vast majority of yidden, even those not fluent in yiddish, were paying attention to the yiddish speaking rabbonim shlita. They were looking at the scrolling English translation at citifield or asking their neighbors (ie at the other venues) what the rabbonim were saying. Many got a sense even without a translation. Just like the Polish Minister who understood the Chofetz Chaim, who spoke in yiddish even though the Minister didn’t, and there was no translation.