Galen Andrew

Training Production Language Models without Memorizing User Data

2020 · arXiv (Cornell University)

This paper presents the first consumer-scale next-word prediction (NWP) model trained with Federated Learning (FL) while leveraging the Differentially Private Federated Averaging (DP-FedAvg) technique. There has been prior work on building practical FL infrastructure, including …