Kevin Scaman

Improved Stability and Generalization Guarantees of the Decentralized SGD Algorithm

2023 · arXiv (Cornell University)

This paper presents a new generalization error analysis for Decentralized Stochastic Gradient Descent (D-SGD) based on algorithmic stability. The obtained results overhaul a series of recent works that suggested an increased instability due to decentralization …