Hersche, Michael

Limits of Transformer Language Models on Learning to Compose Algorithms

2024 · arXiv (Cornell University)

We analyze the capabilities of Transformer language models in learning compositional discrete tasks. To this end, we evaluate training LLaMA models and prompting GPT-4 and Gemini on four tasks demanding to learn a composition of …