Lifu Wang

Is the Skip Connection Provable to Reform the Neural Network Loss Landscape?

2020 · arXiv (Cornell University)

The residual network is now one of the most effective structures in deep learning, which utilizes the skip connections to ``guarantee" the performance will not get worse. However, the non-convexity of the neural network makes …