Jongwon Lee

How language models extrapolate outside the training data: A case study in Textualized Gridworld

2024 · arXiv (Cornell University)

Language models' ability to extrapolate learned behaviors to novel, more complex environments beyond their training scope is highly unknown. This study introduces a path planning task in a textualized Gridworld to probe language models' extrapolation …