Researcher profile
Geoffrey E. Hinton
2 papers in the PaperMetrix corpus
Publications
Papers by this author
-
Large scale distributed neural network training through online\n distillation
2018 · arXiv (Cornell University)
Techniques such as ensembling and distillation promise model quality\nimprovements when paired with almost any base model. However, due to increased\ntest-time cost (for ensembles) and increased complexity of the training\npipeline (for distillation), these techniques are challenging …
-
A Simple Way to Initialize Recurrent Networks of Rectified Linear Units
2015 · arXiv (Cornell University)
Learning long term dependencies in recurrent networks is difficult due to vanishing and exploding gradients. To overcome this difficulty, researchers have developed sophisticated optimization techniques and network architectures. In this paper, we propose a simpler …