Zhou, Sijia

Learning to Sample in Stochastic Optimization

2025 · University of Birmingham Research Portal (University of Birmingham)

We consider a PAC-Bayes analysis of stochastic optimization algorithms, and devise a new SGDA algorithm inspired from our bounds. Our algorithm learns a data-dependent sampling scheme along with model parameters, which may be seen as …