Jakob Ambsdorf

DIET-CP: Lightweight and Data Efficient Self Supervised Continued Pretraining

2025 · arXiv (Cornell University)

Continued pretraining offers a promising solution for adapting foundation models to a new target domain. However, in specialized domains, available datasets are often very small, limiting the applicability of SSL methods developed for large-scale pretraining …