Durga Sivasubramanian

Adaptive Mixing of Auxiliary Losses in Supervised Learning

2023 · Proceedings of the AAAI Conference on Artificial Intelligence

In many supervised learning scenarios, auxiliary losses are used in order to introduce additional information or constraints into the supervised learning objective. For instance, knowledge distillation aims to mimic outputs of a powerful teacher model; …