Researcher profile

Jeffrey Pennington

2 papers in the PaperMetrix corpus

Publications

Papers by this author

  1. Dynamical Isometry and a Mean Field Theory of RNNs: Gating Enables Signal Propagation in Recurrent Neural Networks

    2018 · arXiv (Cornell University)

    Recurrent neural networks have gained widespread use in modeling sequence data across various domains. While many successful recurrent architectures employ a notion of gating, the exact mechanism that enables such remarkable performance is not well …

  2. Disentangling Trainability and Generalization in Deep Neural Networks

    2019 · arXiv (Cornell University)

    A longstanding goal in the theory of deep learning is to characterize the conditions under which a given neural network architecture will be trainable, and if so, how well it might generalize to unseen data. …