Fersini E.

Soft metrics for evaluation with disagreements: an assessment

2024 · BOA (University of Milano-Bicocca)

The move towards preserving judgement disagreements in NLP requires the identification of adequate evaluation metrics. We identify a set of key properties that such metrics should have, and assess the extent to which natural candidates …