Scott A. Hale

Information Ecosystem Threats in Minoritized Communities

2022 · Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval

Journalists, fact-checkers, academics, and community media are overwhelmed in their attempts to support communities suffering from gender-, race- and ethnicity-targeted information ecosystem threats, including but not limited to misinformation, hate speech, weaponized controversy and online-to-offline …

LINGOLY: A Benchmark of Olympiad-Level Linguistic Reasoning Puzzles in Low-Resource and Extinct Languages

2024 · arXiv (Cornell University)

In this paper, we present the LingOly benchmark, a novel benchmark for advanced reasoning abilities in large language models. Using challenging Linguistic Olympiad puzzles, we evaluate (i) capabilities for in-context identification and generalisation of linguistic …

HateDay: Insights from a Global Hate Speech Dataset Representative of a Day on Twitter

2024 · arXiv (Cornell University)

To address the global challenge of online hate speech, prior research has developed detection models to flag such content on social media. However, due to systematic biases in evaluation datasets, the real-world effectiveness of these …

When Claims Evolve: Evaluating and Enhancing the Robustness of Embedding Models Against Misinformation Edits

2025

Online misinformation remains a critical challenge, and fact-checkers increasingly rely on claim matching systems that use sentence embedding models to retrieve relevant fact-checks.However, as users interact with claims online, they often introduce edits, and it …