Matthew Lease

Learning to Effectively Select Topics For Information Retrieval Test Collections.

2017 · arXiv (Cornell University)

While test collections are commonly employed to evaluate the effectiveness of information retrieval (IR) systems, constructing these collections has become increasingly expensive in recent years as collection sizes have grown ever-larger. To address this, we …

New Metrics to Encourage Innovation and Diversity in Information Retrieval Approaches

2023 · arXiv (Cornell University)

In evaluation campaigns, participants often explore variations of popular, state-of-the-art baselines as a low-risk strategy to achieve competitive results. While effective, this can lead to local "hill climbing" rather than more radical and innovative departure …