Sonja Schimmler

Social Bias in Popular Question-Answering Benchmarks

2025 · arXiv (Cornell University)

Question-answering (QA) and reading comprehension (RC) benchmarks are commonly used for assessing the capabilities of large language models (LLMs) to retrieve and reproduce knowledge. However, we demonstrate that popular QA and RC benchmarks do not …