Jabez Magomere

LINGOLY: A Benchmark of Olympiad-Level Linguistic Reasoning Puzzles in Low-Resource and Extinct Languages

2024 · arXiv (Cornell University)

In this paper, we present the LingOly benchmark, a novel benchmark for advanced reasoning abilities in large language models. Using challenging Linguistic Olympiad puzzles, we evaluate (i) capabilities for in-context identification and generalisation of linguistic …

When Claims Evolve: Evaluating and Enhancing the Robustness of Embedding Models Against Misinformation Edits

2025

Online misinformation remains a critical challenge, and fact-checkers increasingly rely on claim matching systems that use sentence embedding models to retrieve relevant fact-checks.However, as users interact with claims online, they often introduce edits, and it …