Pradeep Shenoy

Instance-Conditional Timescales of Decay for Non-Stationary Learning

2022 · arXiv (Cornell University)

Slow concept drift is a ubiquitous, yet under-studied problem in practical machine learning systems. In such settings, although recent data is more indicative of future data, naively prioritizing recent instances runs the risk of losing …

Adaptive Mixing of Auxiliary Losses in Supervised Learning

2023 · Proceedings of the AAAI Conference on Artificial Intelligence

In many supervised learning scenarios, auxiliary losses are used in order to introduce additional information or constraints into the supervised learning objective. For instance, knowledge distillation aims to mimic outputs of a powerful teacher model; …