Zi Gong

CoBa: Convergence Balancer for Multitask Finetuning of Large Language Models

2024 · arXiv (Cornell University)

Multi-task learning (MTL) benefits the fine-tuning of large language models (LLMs) by providing a single model with improved performance and generalization ability across tasks, presenting a resource-efficient alternative to developing separate models for each task. …