Zhunxuan Wang

Learning Two-Layer Residual Networks with Nonparametric Function Estimation by Convex Programming.

2020 · arXiv (Cornell University)

We focus on learning a two-layer residual neural network with preactivation by ReLU (preReLU-TLRN): Suppose the input $\mathbf{x}$ is from a distribution with support space $\mathbb{R}^d$ and the ground-truth generative model is a preReLU-TLRN, given …