Jonathan Thomm

Limits of Transformer Language Models on Learning to Compose Algorithms

2024 · arXiv (Cornell University)

We analyze the capabilities of Transformer language models in learning compositional discrete tasks. To this end, we evaluate training LLaMA models and prompting GPT-4 and Gemini on four tasks demanding to learn a composition of …

Aristotle: IMO-level Automated Theorem Proving

2025 · arXiv (Cornell University)

We introduce Aristotle, an AI system that combines formal verification with informal reasoning, achieving gold-medal-equivalent performance on the 2025 International Mathematical Olympiad problems. Aristotle integrates three main components: a Lean proof search system, an informal …