Shen Ren

Learning Compact Neural Networks with Deep Overparameterised Multitask Learning

2023 · arXiv (Cornell University)

Compact neural network offers many benefits for real-world applications. However, it is usually challenging to train the compact neural networks with small parameter sizes and low computational costs to achieve the same or better model …

Mind the Cost of Scaffold! Benign Clients May Even Become Accomplices of Backdoor Attack

2024 · arXiv (Cornell University)

By using a control variate to calibrate the local gradient of each client, Scaffold has been widely known as a powerful solution to mitigate the impact of data heterogeneity in Federated Learning. Although Scaffold achieves …