Locatelli, Acyr

Procedural Knowledge in Pretraining Drives Reasoning in Large Language Models

2024 · arXiv (Cornell University)

The capabilities and limitations of Large Language Models have been sketched out in great detail in recent years, providing an intriguing yet conflicting picture. On the one hand, LLMs demonstrate a general ability to solve …