S Vineeth

Unbiased Single-scale and Multi-scale Quantizers for Distributed Optimization

2021 · arXiv (Cornell University)

Massive amounts of data have led to the training of large-scale machine learning models on a single worker inefficient. Distributed machine learning methods such as Parallel-SGD have received significant interest as a solution to tackle …