Xiaomeng Jin

Unlearning as multi-task optimization: A normalized gradient difference approach with an adaptive learning rate

2024 · arXiv (Cornell University)

Machine unlearning has been used to remove unwanted knowledge acquired by large language models (LLMs). In this paper, we examine machine unlearning from an optimization perspective, framing it as a regularized multi-task optimization problem, where …