Zirui Xu

Efficient Neural Network Implementation with Quadratic Neuron

2020 · arXiv (Cornell University)

Previous works proved that the combination of the linear neuron network with nonlinear activation functions (e.g. ReLu) can achieve nonlinear function approximation. However, simply widening or deepening the network structure will introduce some training problems. …