Qiaobo Li

Sketched Adaptive Federated Deep Learning: A Sharp Convergence Analysis

2024 · arXiv (Cornell University)

Combining gradient compression methods (e.g., CountSketch, quantization) and adaptive optimizers (e.g., Adam, AMSGrad) is a desirable goal in federated learning (FL), with potential benefits on both fewer communication rounds and less per-round communication. In spite …