Eric B. Jang

Multi-Game Decision Transformers

2022 · arXiv (Cornell University)

A longstanding goal of the field of AI is a method for learning a highly capable, generalist agent from diverse experience. In the subfields of vision and language, this was largely achieved by scaling up …

Do As I Can, Not As I Say: Grounding Language in Robotic Affordances

2022 · arXiv (Cornell University)

Large language models can encode a wealth of semantic knowledge about the world. Such knowledge could be extremely useful to robots aiming to act upon high-level, temporally extended instructions expressed in natural language. However, a …