Daniel Deutsch

Incorporating Question Answering-Based Signals into Abstractive Summarization via Salient Span Selection

2023

In this work, we propose a method for incorporating question-answering (QA) signals into a summarization model. Our method identifies salient noun phrases (NPs) in the input document by automatically generating wh-questions that are answered by …

Beyond Human-Only: Evaluating Human-Machine Collaboration for Collecting High-Quality Translation Data

2024 · arXiv (Cornell University)

Collecting high-quality translations is crucial for the development and evaluation of machine translation systems. However, traditional human-only approaches are costly and slow. This study presents a comprehensive investigation of 11 approaches for acquiring translation data, …

Mitigating Metric Bias in Minimum Bayes Risk Decoding

2024 · arXiv (Cornell University)

While Minimum Bayes Risk (MBR) decoding using metrics such as COMET or MetricX has outperformed traditional decoding methods such as greedy or beam search, it introduces a challenge we refer to as metric bias. As …

MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Task

2024

In this paper, we present the MetricX-24 submissions to the WMT24 Metrics Shared Task and provide details on the improvements we made over the previous version of MetricX.Our primary submission is a hybrid referencebased/-free metric, …