An Zou

TimeBill: Time-Budgeted Inference for Large Language Models

2026 · Proceedings of the AAAI Conference on Artificial Intelligence

Large Language Models (LLMs) are increasingly deployed in time-critical systems, such as robotics, autonomous driving, embodied intelligence, and industrial automation, where generating accurate responses within a given time budget is crucial for decision-making, control, or …