Dilxat Muhtar

MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning

2024 · arXiv (Cornell University)

Parameter-efficient fine-tuning (PEFT) has been widely employed for domain adaptation, with LoRA being one of the most prominent methods due to its simplicity and effectiveness. However, in multi-task learning (MTL) scenarios, LoRA tends to obscure …