preprint Open access

MILE-RefHumEval: A Reference-Free, Multi-Independent LLM Framework for Human-Aligned Evaluation

  • HAL (Le Centre pour la Communication Scientifique Directe)
  • Centre National de la Recherche Scientifique
Research footprint

At a glance

Citations
0
References
0
Comments
0
Paper overview

Abstract

We introduce MILE-RefHumEval, a reference-free framework for evaluating Large Language Models (LLMs) without ground-truth annotations or evaluator coordination. It leverages an ensemble of independently prompted evaluators guided by a human-aligned schema, supporting both discrete and continuous scoring judgement. With task-specific prompts from best candidate selection, summarization and image captioning to dialogue, MILE-RefHumEval provides flexible, interpretable, and scalable assessments. Experiments show it aligns closely with human judgments, outperforms prior methods, and reduces computational overhead, offering an efficient, robust, and human-aligned solution for real-world LLM evaluation.

Record transparency

Publication details

OpenAlex
W7120287864
Document type
preprint
Language
EN
Source
HAL (Le Centre pour la Communication Scientifique Directe)
Last metadata update
Community

Comments

Log in to join the discussion.

  1. No comments yet. Start the discussion.