Soumyadip Ghosh

EventGraD: Event-Triggered Communication in Parallel Stochastic Gradient Descent

2020

Communication in parallel systems consumes significant amount of time and energy which often turns out to be a bottleneck in distributed machine learning. In this paper, we present EventGraD - an algorithm with event-triggered communication …