Shashank Rajput

DETOX: A Redundancy-based Framework for Faster and More Robust Gradient Aggregation

2019 · arXiv (Cornell University)

To improve the resilience of distributed training to worst-case, or Byzantine node failures, several recent approaches have replaced gradient averaging with robust aggregation methods. Such techniques can have high computational costs, often quadratic in the …