Weihua Du

Optimizing Temperature for Language Models with Multi-Sample Inference

2025 · arXiv (Cornell University)

Multi-sample aggregation strategies, such as majority voting and best-of-N sampling, are widely used in contemporary large language models (LLMs) to enhance predictive accuracy across various tasks. A key challenge in this process is temperature selection, …