Harrie Oosterhuis

Learning-to-Rank at the Speed of Sampling

2022 · Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval

Plackett-Luce gradient estimation enables the optimization of stochastic ranking models within feasible time constraints through sampling techniques. Unfortunately, the computational complexity of existing methods does not scale well with the length of the rankings, i.e. …

Reliable Confidence Intervals for Information Retrieval Evaluation Using Generative A.I.

2024

The traditional evaluation of information retrieval (IR) systems is generally very costly as it requires manual relevance annotation from human experts. Recent advancements in generative artificial intelligence -specifically large language models (LLMs)- can generate relevance …