Huang, Shuyu

A Comprehensive Study on Quantization Techniques for Large Language Models

2024 · arXiv (Cornell University)

Large Language Models (LLMs) have been extensively researched and used in both academia and industry since the rise in popularity of the Transformer model, which demonstrates excellent performance in AI. However, the computational demands of …