Judith Rousseau

On the Selection of Initialization and Activation Function for Deep Neural Networks

2018 · arXiv (Cornell University)

The weight initialization and the activation function of deep neural networks have a crucial impact on the performance of the training procedure. An inappropriate selection can lead to the loss of information of the input …