Melanie Nakagawa

Energy Use of AI Inference: Efficiency Pathways and Test-Time Compute

2026 · Zenodo (CERN European Organization for Nuclear Research)

As AI inference scales to billions of queries, estimates of per-query energy use are increasingly important for capacity planning, efficiency interventions, and policy. Yet many public estimates assume non-production settings, leading to systematic overestimation. We …