Anke Tang

Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging

2025 · IEEE Transactions on Pattern Analysis and Machine Intelligence

Multi-task learning (MTL) leverages a shared model to accomplish multiple tasks and facilitate knowledge transfer. Recent research on task arithmetic-based MTL demonstrates that merging the parameters of independently fine-tuned models can effectively achieve MTL. However, …