Pierre Marion

Taking a Big Step: Large Learning Rates in Denoising Score Matching Prevent Memorization

2025 · arXiv (Cornell University)

Denoising score matching plays a pivotal role in the performance of diffusion-based generative models. However, the empirical optimal score--the exact solution to the denoising score matching--leads to memorization, where generated samples replicate the training data. …