Fereshte Khani

Counterbalancing Teacher: Regularizing Batch Normalized Models for Robustness

2022 · arXiv (Cornell University)

Batch normalization (BN) is a ubiquitous technique for training deep neural networks that accelerates their convergence to reach higher accuracy. However, we demonstrate that BN comes with a fundamental drawback: it incentivizes the model to …