Haosen Shi

Learning Compact Neural Networks with Deep Overparameterised Multitask Learning

2023 · arXiv (Cornell University)

Compact neural network offers many benefits for real-world applications. However, it is usually challenging to train the compact neural networks with small parameter sizes and low computational costs to achieve the same or better model …