Derek Tam

Merging by Matching Models in Task Parameter Subspaces

2023 · arXiv (Cornell University)

Model merging aims to cheaply combine individual task-specific models into a single multitask model. In this work, we view past merging methods as leveraging different notions of a ''task parameter subspace'' in which models are …