Shiqiang Wang

Straggler-Resilient Decentralized Learning via Adaptive Asynchronous Updates

2023 · arXiv (Cornell University)

With the increasing demand for large-scale training of machine learning models, fully decentralized optimization methods have recently been advocated as alternatives to the popular parameter server framework. In this paradigm, each worker maintains a local …