Yuanhang Yang

When Federated Learning Meets Pre-trained Language Models' Parameter-Efficient Tuning Methods

2022 · arXiv (Cornell University)

With increasing privacy concerns on data, recent studies have made significant progress using federated learning (FL) on privacy-sensitive natural language processing (NLP) tasks. Much literature suggests fully fine-tuning pre-trained language models (PLMs) in the FL …