Ankita Gupta

DEMETR: Diagnosing Evaluation Metrics for Translation

2022 · arXiv (Cornell University)

While machine translation evaluation metrics based on string overlap (e.g., BLEU) have their limitations, their computations are transparent: the BLEU score assigned to a particular candidate translation can be traced back to the presence or …

NarrativeTime: Dense Temporal Annotation on a Timeline

2019 · arXiv (Cornell University)

For the past decade, temporal annotation has been sparse: only a small portion of event pairs in a text was annotated. We present NarrativeTime, the first timeline-based annotation framework that achieves full coverage of all …

ezCoref: Towards Unifying Annotation Guidelines for Coreference Resolution

2022 · arXiv (Cornell University)

Large-scale, high-quality corpora are critical for advancing research in coreference resolution. However, existing datasets vary in their definition of coreferences and have been collected via complex and lengthy guidelines that are curated for linguistic experts. …