Soufiane Hayou
3 papers in the PaperMetrix corpus
Papers by this author
-
On the Selection of Initialization and Activation Function for Deep Neural Networks
2018 · arXiv (Cornell University)
The weight initialization and the activation function of deep neural networks have a crucial impact on the performance of the training procedure. An inappropriate selection can lead to the loss of information of the input …
-
The Equilibrium Hypothesis: Rethinking implicit regularization in Deep Neural Networks.
2021 · arXiv (Cornell University)
Modern Deep Neural Networks (DNNs) exhibit impressive generalization properties on a variety of tasks without explicit regularization, suggesting the existence of hidden regularization effects. Recent work by Baratin et al. (2021) sheds light on an …
-
On the Connection Between Riemann Hypothesis and a Special Class of Neural Networks
2023 · arXiv (Cornell University)
The Riemann hypothesis (RH) is a long-standing open problem in mathematics. It conjectures that non-trivial zeros of the zeta function all have real part equal to 1/2. The extent of the consequences of RH is …