Kong, Weiwei

Differentially Private Optimization for Non-Decomposable Objective Functions

2023 · arXiv (Cornell University)

Unsupervised pre-training is a common step in developing computer vision models and large language models. In this setting, the absence of labels requires the use of similarity-based loss functions, such as contrastive loss, that favor …