Kejian Shi

SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literature

2024 · arXiv (Cornell University)

We present SciRIFF (Scientific Resource for Instruction-Following and Finetuning), a dataset of 137K instruction-following instances for training and evaluation, covering 54 tasks. These tasks span five core scientific literature understanding capabilities: information extraction, summarization, question …

MSRS: Evaluating Multi-Source Retrieval-Augmented Generation

2025 · arXiv (Cornell University)

Retrieval-augmented systems are typically evaluated in settings where information required to answer the query can be found within a single source or the answer is short-form or factoid-based. However, many real-world applications demand the ability …