Soheil Zibakhsh Shabgahi

LayerCollapse: Adaptive compression of neural networks

2023 · arXiv (Cornell University)

Handling the ever-increasing scale of contemporary deep learning and transformer-based models poses a significant challenge. Overparameterized Transformer networks outperform prior art in Natural Language processing and Computer Vision. These models contain hundreds of millions of …