Leonard Tang

Learning the Wrong Lessons: Inserting Trojans During Knowledge Distillation

2023 · arXiv (Cornell University)

In recent years, knowledge distillation has become a cornerstone of efficiently deployed machine learning, with labs and industries using knowledge distillation to train models that are inexpensive and resource-optimized. Trojan attacks have contemporaneously gained significant …