Petr Šimánek

Investigation into the Training Dynamics of Learned Optimizers

2023 · arXiv (Cornell University)

Optimization is an integral part of modern deep learning. Recently, the concept of learned optimizers has emerged as a way to accelerate this optimization process by replacing traditional, hand-crafted algorithms with meta-learned functions. Despite the …