Pinyan Lu

M-Mix

2022 · Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining

Negative pairs, especially hard negatives as combined with common negatives (easy to discriminate), are essential in contrastive learning, which plays a role of avoiding degenerate solutions in the sense of constant representation across different instances. …