Jay Roberts

THELMA: Task Based Holistic Evaluation of Large Language Model Applications-RAG Question Answering

2025 · arXiv (Cornell University)

We propose THELMA (Task Based Holistic Evaluation of Large Language Model Applications), a reference free framework for RAG (Retrieval Augmented generation) based question answering (QA) applications. THELMA consist of six interdependent metrics specifically designed for …