Lu Hou

Extending Context Window of Large Language Models via Semantic Compression

2023 · arXiv (Cornell University)

Transformer-based Large Language Models (LLMs) often impose limitations on the length of the text input to ensure the generation of fluent and relevant responses. This constraint restricts their applicability in scenarios involving long texts. We …

DeCo: Decoupling Token Compression from Semantic Abstraction in Multimodal Large Language Models

2024 · arXiv (Cornell University)

The visual projector, which bridges the vision and language modalities and facilitates cross-modal alignment, serves as a crucial component in MLLMs. However, measuring the effectiveness of projectors in vision-language alignment remains under-explored, which currently can …

Quantum Algorithms for the Multiplication of Circulant Matrices and Vectors

2024 · Information

This article presents two quantum algorithms for computing the product of a circulant matrix and a vector. The arithmetic complexity of the first algorithm is O(Nlog2N) in most cases. For the second algorithm, when the …