Chong You

Learning Diverse and Discriminative Representations via the Principle of Maximal Coding Rate Reduction

2020 · arXiv (Cornell University)

To learn intrinsic low-dimensional structures from high-dimensional data that most discriminate between classes, we propose the principle of Maximal Coding Rate Reduction ($\text{MCR}^2$), an information-theoretic measure that maximizes the coding rate difference between the whole …

It's an Alignment, Not a Trade-off: Revisiting Bias and Variance in Deep Models

2023 · arXiv (Cornell University)

Classical wisdom in machine learning holds that the generalization error can be decomposed into bias and variance, and these two terms exhibit a \emph{trade-off}. However, in this paper, we show that for an ensemble of …