Renjie Liu

MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices

2020

Natural Language Processing (NLP) has recently achieved great success by using huge pre-trained models with hundreds of millions of parameters. However, these models suffer from heavy model sizes and high latency such that they cannot …