Jie Ruan

Better than Random: Reliable NLG Human Evaluation with Constrained Active Sampling

2024 · arXiv (Cornell University)

Human evaluation is viewed as a reliable evaluation method for NLG which is expensive and time-consuming. To save labor and costs, researchers usually perform human evaluation on a small subset of data sampled from the …