Lixin Cao

Trinet: Stabilizing Self-Supervised Learning From Complete or Slow Collapse

2023

Self-supervised learning (SSL) models confront challenges of abrupt informational collapse or slow dimensional collapse. We propose TriNet, which introduces a novel triple-branch architecture for preventing collapse and stabilizing the pretraining. TriNet learns the SSL latent …