Parameter-Efficient Fine-Tuning: LoRA, QLoRA, and DoRA

A technical note comparing parameter-efficient fine-tuning techniques for large language models, including Low-Rank Adaptation (LoRA), its quantized variant QLoRA, and Weight-Decomposed Low-Rank Adaptation (DoRA).