Hongyang R. Zhang

Efficient Ensemble for Fine-tuning Language Models on Multiple Datasets

2025

This paper develops an ensemble method for fine-tuning a language model to multiple datasets.Existing methods, such as quantized LoRA (QLoRA), are efficient when adapting to a single dataset.When training on multiple datasets of different tasks, …