Sarik Ghazarian

MERCY: Multiple Response Ranking Concurrently in Realistic Open-Domain Conversational Systems

2023

Automatic Evaluation (AE) and Response Selection (RS) models assign quality scores to various candidate responses and rank them in conversational setups. Prior response ranking research compares various models’ performance on synthetically generated test sets. In …

Better Automatic Evaluation of Open-Domain Dialogue Systems with Contextualized Embeddings

2019

Despite advances in open-domain dialogue systems, automatic evaluation of such systems is still a challenging problem. Traditional reference-based metrics such as BLEU are ineffective because there could be many valid responses for a given context …