Pulin Gong

Anomalous diffusion dynamics of learning in deep neural networks

2020 · arXiv (Cornell University)

Learning in deep neural networks (DNNs) is implemented through minimizing a highly non-convex loss function, typically by a stochastic gradient descent (SGD) method. This learning process can effectively find good wide minima without being trapped …