Virgile Rennard

BERTweetFR : Domain Adaptation of Pre-Trained Language Models for French Tweets

2021 · arXiv (Cornell University)

We introduce BERTweetFR, the first large-scale pre-trained language model for French tweets. Our model is initialized using the general-domain French language model CamemBERT which follows the base architecture of RoBERTa. Experiments show that BERTweetFR outperforms …