Deepak Ravikumar

Homogenizing Non-IID datasets via In-Distribution Knowledge Distillation for Decentralized Learning

2023 · arXiv (Cornell University)

Decentralized learning enables serverless training of deep neural networks (DNNs) in a distributed manner on multiple nodes. This allows for the use of large datasets, as well as the ability to train with a wide …