Jasdeep Singh

XLDA: Cross-Lingual Data Augmentation for Natural Language Inference and Question Answering

2019 · arXiv (Cornell University)

While natural language processing systems often focus on a single language, multilingual transfer learning has the potential to improve performance, especially for low-resource languages. We introduce XLDA, cross-lingual data augmentation, a method that replaces a …

BERT is Not an Interlingua and the Bias of Tokenization

2019

Multilingual transfer learning can benefit both high-and low-resource languages, but the source of these improvements is not well understood. Cananical Correlation Analysis (CCA) of the internal representations of a pretrained, multilingual BERT model reveals that …