Search Relevance Regression Testing using Search Test Framework

Search relevance regression testing is the process by which search quality is monitored and improved by comparing search results over time, and in particular before and after releases. It helps us to evaluate whether recent changes to the environment, content, application and search algorithms have adversely impacted the results delivered by the search engine in any way, and to take action accordingly. It provides feedback on relevance and allows us to monitor trends and impacts of algorithm changes. This work explores the use of an integrated search testing and instrumentation tool to track regression over time and to highlight changes.