Seonguk Park

On the Orthogonality of Knowledge Distillation with Other Techniques: From an Ensemble Perspective

2020 · arXiv (Cornell University)

To put a state-of-the-art neural network to practical use, it is necessary to design a model that has a good trade-off between the resource consumption and performance on the test set. Many researchers and engineers …