Daniel J. Trosten

Questionable Practices in Methodological Deep Learning Research

2023 · Proceedings of the Northern Lights Deep Learning Workshop

Evaluation of new methodology in deep learning (DL) research is typically done by reporting point estimates of a few performance metrics, calculated from a single training run. This paper argues that this frequently used evaluation …