Ekaterina Shemyakova

Comparison of the efficiency of zero and first order minimization methods in neural networks

2022 · Vestnik Universiteta

To minimize the objective function in neural networks, first-order methods are usually used, which involve the repeated calculation of the gradient. The number of variables in modern neural networks can be many thousands and even …