Denis Korzhenkov

On Sampling Strategies for Spectral Model Sharding

2024 · arXiv (Cornell University)

The problem of heterogeneous clients in federated learning has recently drawn a lot of attention. Spectral model sharding, i.e., partitioning the model parameters into low-rank matrices based on the singular value decomposition, has been one …