Hongyi Wang

DETOX: A Redundancy-based Framework for Faster and More Robust Gradient Aggregation

2019 · arXiv (Cornell University)

To improve the resilience of distributed training to worst-case, or Byzantine node failures, several recent approaches have replaced gradient averaging with robust aggregation methods. Such techniques can have high computational costs, often quadratic in the …

Memory-adaptive Depth-wise Heterogeneous Federated Learning

2023 · arXiv (Cornell University)

Federated learning is a promising paradigm that allows multiple clients to collaboratively train a model without sharing the local data. However, the presence of heterogeneous devices in federated learning, such as mobile phones and IoT …