Xiangrui Liu

Emerging Safety Attack and Defense in Federated Instruction Tuning of Large Language Models

2024 · arXiv (Cornell University)

Federated learning (FL) enables multiple parties to collaboratively fine-tune an large language model (LLM) without the need of direct data sharing. Ideally, by training on decentralized data that is aligned with human preferences and safety …