Ali Behrouz

ATLAS: Learning to Optimally Memorize the Context at Test Time

2025 · arXiv (Cornell University)

Transformers have been established as the most popular backbones in sequence modeling, mainly due to their effectiveness in in-context retrieval tasks and the ability to learn at scale. Their quadratic memory and time complexity, however, …