Tian Yu Liu

Tangent Model Composition for Ensembling and Continual Fine-tuning

2023 · arXiv (Cornell University)

Tangent Model Composition (TMC) is a method to combine component models independently fine-tuned around a pre-trained point. Component models are tangent vectors to the pre-trained model that can be added, scaled, or subtracted to support …