Shanshan Gu

StyleBERT: Chinese Pretraining by Font Style Information

2022 · 2022 IEEE 10th Joint International Information Technology and Artificial Intelligence Conference (ITAIC)

With the success of down streaming task using English pre-trained language model, the pre-trained Chinese language model is also necessary to get better performance of Chinese NLP tasks. Unlike the English language, Chinese has its …