How about the language from the torah and the gemarah? Ancient Hebrew and Aramaic , which is really closer to Arabic? (they are semetic languages)
By the way I know of many people who are practically assimilated but think that the fact that makes them Jewish is that they speak Yiddish, so sad.