Maja Popović

chrF: character n-gram F-score for automatic MT evaluation

2015

We propose the use of character n-gram F-score for automatic evaluation of machine translation output. Character ngrams have already been used as a part of more complex metrics, but their individual potential has not been …

Neural Machine Translation for translating into Croatian and Serbian

2020 · Dublin City University Open Access Institutional Repository (Dublin City University)

In this work, we systematically investigate different set-ups for training of neural machine translation (NMT) systems for translation into Croatian and Serbian, two closely related South Slavic languages. We explore English and German as source …

Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation

2024 · arXiv (Cornell University)

High-quality Machine Translation (MT) evaluation relies heavily on human judgments. Comprehensive error classification methods, such as Multidimensional Quality Metrics (MQM), are expensive as they are time-consuming and can only be done by experts, whose availability …

chrF++: words helping character n-grams

2017

Character n-gram F-score (CHRF) is shown to correlate very well with human relative rankings of different machine translation outputs, especially for morphologically rich target languages. However, its relation with direct human assessments is not yet …