Artem Sokolov

Sockeye: A Toolkit for Neural Machine Translation

2017 · arXiv (Cornell University)

We describe Sockeye (version 1.12), an open-source sequence-to-sequence toolkit for Neural Machine Translation (NMT). Sockeye is a production-ready framework for training and applying models as well as an experimental platform for researchers. Written in Python …

Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets

2022 · Transactions of the Association for Computational Linguistics

Abstract With the success of large-scale pre-training and multilingual modeling in Natural Language Processing (NLP), recent years have seen a proliferation of large, Web-mined text datasets covering hundreds of languages. We manually audit the quality …