Francesco Trama

Best Token Use Path (BTUP): Client-Side Traffic Engineering for Cost-Aware LLM Inference

2026 · Zenodo (CERN European Organization for Nuclear Research)

Large language models select generation behavior against a trained quality objective that contains no representation of token cost — the inference analogue of a link-state routing protocol whose advertisements omit the cost field. Every path …