Weilin Zhao

PTR: Prompt Tuning with Rules for Text Classification

2022 · AI Open

Recently, prompt tuning has been widely applied to stimulate the rich knowledge in pre-trained language models (PLMs) to serve NLP tasks. Although prompt tuning has achieved promising results on some few-class classification tasks, such as …

Parameter-efficient fine-tuning of large-scale pre-trained language models

2023 · Nature Machine Intelligence

Abstract With the prevalence of pre-trained language models (PLMs) and the pre-training–fine-tuning paradigm, it has been continuously shown that larger models tend to yield better performance. However, as PLMs scale up, fine-tuning and storing all …