Simran Khanuja

mSLAM: Massively multilingual joint pre-training for speech and text

2022 · arXiv (Cornell University)

We present mSLAM, a multilingual Speech and LAnguage Model that learns cross-lingual cross-modal representations of speech and text by pre-training jointly on large amounts of unlabeled speech and text in multiple languages. mSLAM combines w2v-BERT …