Rudolf Rosa

How Language-Neutral is Multilingual BERT?

2019 · arXiv (Cornell University)

Multilingual BERT (mBERT) provides sentence representations for 104 languages, which are useful for many multi-lingual tasks. Previous work probed the cross-linguality of mBERT using zero-shot transfer learning on morphological and syntactic tasks. We instead focus …