Jayakumar Subramanian

Voice Evaluation of Reasoning Ability: Diagnosing the Modality-Induced Performance Gap

2025 · arXiv (Cornell University)

We present Voice Evaluation of Reasoning Ability (VERA), a benchmark for evaluating reasoning ability in voice-interactive systems under real-time conversational constraints. VERA comprises 2,931 voice-native episodes derived from established text benchmarks and organized into five …