David Wadden

Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2

2023 · arXiv (Cornell University)

Since the release of TÜLU [Wang et al., 2023b], open resources for instruction tuning have developed quickly, from better base models to new finetuning techniques. We test and incorporate a number of these advances into …

SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literature

2024 · arXiv (Cornell University)

We present SciRIFF (Scientific Resource for Instruction-Following and Finetuning), a dataset of 137K instruction-following instances for training and evaluation, covering 54 tasks. These tasks span five core scientific literature understanding capabilities: information extraction, summarization, question …

2 OLMo 2 Furious

2024 · arXiv (Cornell University)

We present OLMo 2, the next generation of our fully open language models. OLMo 2 includes a family of dense autoregressive language models at 7B, 13B and 32B scales with fully released artifacts -- model …