Jonathan Tompson

Learning Interactive Real-World Simulators

2023 · arXiv (Cornell University)

Generative models trained on internet data have revolutionized how text, image, and video content can be created. Perhaps the next milestone for generative models is to simulate realistic experience in response to actions taken by …

Inner Monologue: Embodied Reasoning through Planning with Language Models

2022 · arXiv (Cornell University)

Recent works have shown how the reasoning capabilities of Large Language Models (LLMs) can be applied to domains beyond natural language processing, such as planning and interaction for robots. These embodied problems require an agent …