The Evolution of Code Review Research: A Systematic Mapping Study

Code Review (CR) is a cornerstone for Quality Assurance within development teams. Also known as software inspections and walk-throughs, traditional CR involved time-consuming processes, which is different from more lightweight contemporary forms used today. In this paper, we aim to summarize how CR research has evolved into its current state over the last decade. Our vigorous systematic study revolves around four research questions to uncover changes into the target of contributions and methodologies, replicability of existing studies and the evolution of CR terminology. From a collection of 7,266 papers from the top engineering venues, we generate visual maps for 148 collected papers including 53 conferences, 16 journals, and 79 snowball papers. Our visual maps provide evidence that CR research does cover more than quality assurance, and will continue to evolve with the availability of datasets and emerging technologies within the CR domain.