Doğay Altınel

Development of Deep Learning Optimizers: Approaches, Concepts, and Update Rules

2025 · arXiv (Cornell University)

Deep learning optimizers are optimization algorithms that enable deep neural networks to learn. The effectiveness of learning is highly dependent on the optimizer employed in the training process. Alongside the rapid advancement of deep learning, …