Allison Blunt

Assessing AI Utility: The Random Guesser Test for Sequential Decision-Making Systems

2024 · arXiv (Cornell University)

We propose a general approach to quantitatively assessing the risk and vulnerability of artificial intelligence (AI) systems to biased decisions. The guiding principle of the proposed approach is that any AI algorithm must outperform a …