Yoav Levine
3 papers in the PaperMetrix corpus
Papers by this author
-
Which transformer architecture fits my data? A vocabulary bottleneck in self-attention
2021 · arXiv (Cornell University)
After their successful debut in natural language processing, Transformer architectures are now becoming the de-facto standard in many domains. An obstacle for their deployment over new modalities is the architectural configuration: the optimal depth-to-width ratio …
-
Parallel Context Windows for Large Language Models
2023
Nir Ratner, Yoav Levine, Yonatan Belinkov, Ori Ram, Inbal Magar, Omri Abend, Ehud Karpas, Amnon Shashua, Kevin Leyton-Brown, Yoav Shoham. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long …
-
In-Context Retrieval-Augmented Language Models
2023 · Transactions of the Association for Computational Linguistics
Abstract Retrieval-Augmented Language Modeling (RALM) methods, which condition a language model (LM) on relevant documents from a grounding corpus during generation, were shown to significantly improve language modeling performance. In addition, they can mitigate the …