Tongzi Wu

Self-Supervised Representation Learning as Mutual Information Maximization

2025 · arXiv (Cornell University)

Self-supervised representation learning (SSRL) has demonstrated remarkable empirical success, yet its underlying principles remain insufficiently understood. While recent works attempt to unify SSRL methods by examining their information-theoretic objectives or summarizing their heuristics for preventing …