Alex Kogan

Is (Selective) Round-To-Nearest Quantization All You Need?

2025 · arXiv (Cornell University)

Quantization became a necessary tool for serving ever-increasing Large Language Models (LLMs). RTN (Round-to-Nearest) is perhaps the simplest quantization technique that has been around well before LLMs surged to the forefront of machine learning (ML) …