Gobinda Saha

Continual Learning with Scaled Gradient Projection

2023 · arXiv (Cornell University)

In neural networks, continual learning results in gradient interference among sequential tasks, leading to catastrophic forgetting of old tasks while learning new ones. This issue is addressed in recent methods by storing the important gradient …

Homogenizing Non-IID datasets via In-Distribution Knowledge Distillation for Decentralized Learning

2023 · arXiv (Cornell University)

Decentralized learning enables serverless training of deep neural networks (DNNs) in a distributed manner on multiple nodes. This allows for the use of large datasets, as well as the ability to train with a wide …