Tingyu Zhao

Evaluating Long-Context Understanding via Latent and Positional Structure Queries in Large Language Models

2024

The ability to handle long-context dependencies is a critical challenge for modern language models, especially in tasks that require the retention of information over extended input sequences. Differentiating between latent and positional queries introduces a …