Mark Sanderson

A preliminary comparison of job, talent, and web search

2018 · CEUR Workshop Proceedings

Copyright held by the author(s). This paper presents an initial comparison of user behavior in job, talent, and web search using query and click logs from a popular employment marketplace. The observations suggest that the …

How Do You Test a Test?

2022 · Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining

We examine three statistical significance tests -- a recently proposed ANOVA model and two baseline tests -- using a suite of measures to determine which is better suited for offline evaluation. We apply our analysis …

LLMs can be Fooled into Labelling a Document as Relevant: best café near me; this paper is perfectly relevant

2024

Large Language Models (LLMs) are increasingly being used to assess the relevance of information objects. This work reports on experiments to study the labelling of short texts (i.e., passages) for relevance, using multiple open-source and …

Informing the Design of Spoken Conversational Search

2018

We conducted a laboratory-based observational study where pairs of people performed search tasks communicating verbally. Examination of the discourse allowed commonly used interactions to be identified for Spoken Conversational Search (SCS). We compared the interactions …