Xueyan Niu

Extending Context Window of Large Language Models via Semantic Compression

2023 · arXiv (Cornell University)

Transformer-based Large Language Models (LLMs) often impose limitations on the length of the text input to ensure the generation of fluent and relevant responses. This constraint restricts their applicability in scenarios involving long texts. We …