Jingyun Hua

Mengzi: Towards Lightweight yet Ingenious Pre-trained Models for Chinese

2021 · arXiv (Cornell University)

Although pre-trained models (PLMs) have achieved remarkable improvements in a wide range of NLP tasks, they are expensive in terms of time and resources. This calls for the study of training more efficient models with …