Jongjin Park

Regularizing Class-Wise Predictions via Self-Knowledge Distillation

2020

Deep neural networks with millions of parameters may suffer from poor generalization due to overfitting. To mitigate the issue, we propose a new regularization method that penalizes the predictive distribution between similar samples. In particular, …