Michael J. Wilber

On the Reproducibility of Neural Network Predictions

2021 · arXiv (Cornell University)

Standard training techniques for neural networks involve multiple sources of randomness, e.g., initialization, mini-batch ordering and in some cases data augmentation. Given that neural networks are heavily over-parameterized in practice, such randomness can cause {\em …