Siavash Ameli

A Statistical Framework for Ranking LLM-Based Chatbots

2024 · arXiv (Cornell University)

Large language models (LLMs) have transformed natural language processing, with frameworks like Chatbot Arena providing pioneering platforms for evaluating these models. By facilitating millions of pairwise comparisons based on human judgments, Chatbot Arena has become …