Yun-Hao Cao

Rethinking Self-Supervised Learning: Small is Beautiful

2021 · arXiv (Cornell University)

Self-supervised learning (SSL), in particular contrastive learning, has made great progress in recent years. However, a common theme in these methods is that they inherit the learning paradigm from the supervised deep learning scenario. Current …