Ji Xin

DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference

2020

Large-scale pre-trained language models such as BERT have brought significant improvements to NLP applications. However, they are also notorious for being slow in inference, which makes them difficult to deploy in realtime applications. We propose …