Yuval Kluger

Differentiable Unsupervised Feature Selection based on a Gated Laplacian

2020 · arXiv (Cornell University)

Scientific observations may consist of a large number of variables (features). Identifying a subset of meaningful features is often ignored in unsupervised learning, despite its potential for unraveling clear patterns hidden in the ambient space. …

Exponential weight averaging as damped harmonic motion

2023 · arXiv (Cornell University)

The exponential moving average (EMA) is a commonly used statistic for providing stable estimates of stochastic quantities in deep learning optimization. Recently, EMA has seen considerable use in generative models, where it is computed with …