Phillip Keung

Adversarial Learning with Contextual Embeddings for Zero-resource Cross-lingual Classification and NER

2019 · arXiv (Cornell University)

Contextual word embeddings (e.g. GPT, BERT, ELMo, etc.) have demonstrated state-of-the-art performance on various NLP tasks. Recent work with the multilingual version of BERT has shown that the model performs very well in zero-shot and …

A neural interlingua for multilingual machine translation

2018

We incorporate an explicit neural interlingua into a multilingual encoder-decoder neural machine translation (NMT) architecture. We demonstrate that our model learns a languageindependent representation by performing direct zero-shot translation (without using pivot translation), and by …