Keli Xie

Elbert: Fast Albert with Confidence-Window Based Early Exit

2021 · arXiv (Cornell University)

Despite the great success in Natural Language Processing (NLP) area, large pre-trained language models like BERT are not well-suited for resource-constrained or real-time applications owing to the large number of parameters and slow inference speed. …