James, Jenna

OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens

2025 · arXiv (Cornell University)

We present OLMoTrace, the first system that traces the outputs of language models back to their full, multi-trillion-token training data in real time. OLMoTrace finds and shows verbatim matches between segments of language model output …