Siyao Peng

A Rose by Any Other Name: LLM-Generated Explanations Are Good Proxies for Human Explanations to Collect Label Distributions on NLI

2025

Disagreement in human labeling is ubiquitous, and can be captured in human judgment distributions (HJDs).Recent research has shown that explanations provide valuable information for understanding human label variation (HLV) and large language models (LLMs) can …

References Matter: Investigating the Impact of Reference Set Variation on Summarization Evaluation

2025 · arXiv (Cornell University)

Human language production exhibits remarkable richness and variation, reflecting diverse communication styles and intents. However, this variation is often overlooked in summarization evaluation. While having multiple reference summaries is known to improve correlation with human …