Evaluation of self-adaptive systems

Statistically, the number of women in computer science is significantly lower than the number of men working in the same domain. This applies also to the subarea of software architectures. We would like to outline that there may be also exceptions: there are more women than men leading and working in the evaluation of autonomic and self-adaptive issues in software systems. In this paper, we introduce seven research approaches involving women in the evaluation of self-adaptive systems. Further, we discuss the heterogeneity of these evaluation approaches from various points of view (e.g., types of systems addressed, types of evaluation, qualitative vs quantitative or static vs dynamic). The paper ends with our thoughts and perspectives on future needs and trends in the evaluation of self-adaptive systems.