Guillaume Richard

PASTA: Pretrained Action-State Transformer Agents

2023 · arXiv (Cornell University)

Self-supervised learning has brought about a revolutionary paradigm shift in various computing domains, including NLP, vision, and biology. Recent approaches involve pre-training transformer models on vast amounts of unlabeled data, serving as a starting point …