Oscar Sainz

Recent Advances in Natural Language Processing via Large Pre-trained Language Models: A Survey

2023 · ACM Computing Surveys

Large, pre-trained language models (PLMs) such as BERT and GPT have drastically changed the Natural Language Processing (NLP) field. For numerous NLP tasks, approaches leveraging PLMs have achieved state-of-the-art performance. The key idea is to …