Chen, Zhengsu

QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models

2023 · arXiv (Cornell University)

Recently years have witnessed a rapid development of large language models (LLMs). Despite the strong ability in many language-understanding tasks, the heavy computational burden largely restricts the application of LLMs especially when one needs to …