Researcher profile
Jeffrey Pennington
2 papers in the PaperMetrix corpus
Publications
Papers by this author
-
Dynamical Isometry and a Mean Field Theory of RNNs: Gating Enables Signal Propagation in Recurrent Neural Networks
2018 · arXiv (Cornell University)
Recurrent neural networks have gained widespread use in modeling sequence data across various domains. While many successful recurrent architectures employ a notion of gating, the exact mechanism that enables such remarkable performance is not well …
-
Disentangling Trainability and Generalization in Deep Neural Networks
2019 · arXiv (Cornell University)
A longstanding goal in the theory of deep learning is to characterize the conditions under which a given neural network architecture will be trainable, and if so, how well it might generalize to unseen data. …