Duygu Ataman

Compositional Representation of Morphologically-Rich Input for Neural Machine Translation

2018

Neural machine translation (NMT) models are typically trained with fixed-size input and output vocabularies, which creates an important bottleneck on their accuracy and generalization capability. As a solution, various studies proposed segmenting words into sub-word …

Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets

2022 · Transactions of the Association for Computational Linguistics

Abstract With the success of large-scale pre-training and multilingual modeling in Natural Language Processing (NLP), recent years have seen a proliferation of large, Web-mined text datasets covering hundreds of languages. We manually audit the quality …