Gabriele Berton

CompLLM: Compression for Long Context Q&A

2025 · arXiv (Cornell University)

Large Language Models (LLMs) face significant computational challenges when processing long contexts due to the quadratic complexity of self-attention. While soft context compression methods, which map input text to smaller latent representations, have shown promise, …