Arun Sai Suggala

CDQuant: Greedy Coordinate Descent for Accurate LLM Quantization

2024 · arXiv (Cornell University)

Large language models (LLMs) have recently demonstrated remarkable performance across diverse language tasks. But their deployment is often constrained by their substantial computational and storage requirements. Quantization has emerged as a key technique for addressing …