O. Ozan Koyluoglu

Communication-Efficient Gradient Coding for Straggler Mitigation in\n Distributed Learning

2020 · arXiv (Cornell University)

Distributed implementations of gradient-based methods, wherein a server\ndistributes gradient computations across worker machines, need to overcome two\nlimitations: delays caused by slow running machines called 'stragglers', and\ncommunication overheads. Recently, Ye and Abbe [ICML 2018] proposed a\ncoding-theoretic …