Masayasu Atsumi

Pre-training a BERT with Curriculum Learning by Increasing Block-Size of Input Text

2021

Recently, pre-trained language representation models such as BERT and RoBERTa have achieved significant results in a wide range of natural language processing (NLP) tasks, however, it requires extremely high computational cost. Curriculum learning (CL) is …