Tristan J. Webb

Scaling Laws for Post Training Quantized Large Language Models

2024 · arXiv (Cornell University)

Generalization abilities of well-trained large language models (LLMs) are known to scale predictably as a function of model size. In contrast to the existence of practical scaling laws governing pre-training, the quality of LLMs after …