Zicheng Xu

Physics of Language Models: Part 2.2, How to Learn From Mistakes on Grade-School Math Problems

2024 · arXiv (Cornell University)

Language models have demonstrated remarkable performance in solving reasoning tasks; however, even the strongest models still occasionally make reasoning mistakes. Recently, there has been active research aimed at improving reasoning accuracy, particularly by using pretrained …