Jialong Han

Dual Decomposition of Weights and Singular Value Low Rank Adaptation

2025 · arXiv (Cornell University)

Parameter-Efficient Fine-Tuning (PEFT) has emerged as a critical paradigm for adapting Large Language Models (LLMs) to downstream tasks, among which Low-rank Adaptation (LoRA) represents one of the most widely adopted methodologies. However, existing LoRA-based approaches …