Calvin Luo

Intriguing Properties of Contrastive Losses

2020 · arXiv (Cornell University)

We study three intriguing properties of contrastive learning. First, we generalize the standard contrastive loss to a broader family of losses, and we find that various instantiations of the generalized loss perform similarly under the …