Eunhyeok Park

SEAL: Scaling to Emphasize Attention for Long-Context Retrieval

2025 · arXiv (Cornell University)

While many advanced LLMs are designed to handle long sequence data, we can still observe notable quality degradation even within the sequence limit. In this work, we introduce a novel approach called Scaling to Emphasize …