Mikhail Yurochkin

Your fairness may vary: Group fairness of pretrained language models in toxic text classification.

2021 · arXiv (Cornell University)

We study the performance-fairness trade-off in more than a dozen fine-tuned LMs for toxic text classification. We empirically show that no blanket statement can be made with respect to the bias of large versus regular …

tinyBenchmarks: evaluating LLMs with fewer examples

2024 · arXiv (Cornell University)

The versatility of large language models (LLMs) led to the creation of diverse benchmarks that thoroughly test a variety of language models' abilities. These benchmarks consist of tens of thousands of examples making evaluation of …