Kexin Zhang

Application of Pretrained Models for Machine Translation

2021

In recent years, the pre-training model represented by BERT has achieved significant improvement in many NLP tasks. However, because the MLM pre-training task used by the pre-training language model is different from the auto-regressive language …