Telmo Pires

How multilingual is Multilingual BERT?

2019 · arXiv (Cornell University)

In this paper, we show that Multilingual BERT (M-BERT), released by Devlin et al. (2018) as a single language model pre-trained from monolingual corpora in 104 languages, is surprisingly good at zero-shot cross-lingual model transfer, …