Tom Kocmi

Evaluating Metrics for Document-context Evaluation in Machine Translation

2023

We describe our submission of a new metric, SLIDE (Raunak et al., 2023), to the WMT 2023 metrics task.SLIDE is a reference-free qualityestimation metric that works by constructing a fixed sentence-length window over the documents …

Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation

2024 · arXiv (Cornell University)

High-quality Machine Translation (MT) evaluation relies heavily on human judgments. Comprehensive error classification methods, such as Multidimensional Quality Metrics (MQM), are expensive as they are time-consuming and can only be done by experts, whose availability …

Curriculum Learning and Minibatch Bucketing in Neural Machine Translation

2017

We examine the effects of particular orderings of sentence pairs on the on-line training of neural machine translation (NMT). We focus on two types of such orderings: (1) ensuring that each minibatch contains sentences similar …