Arnav Chavan

One-for-All: Generalized LoRA for Parameter-Efficient Fine-tuning

2023 · arXiv (Cornell University)

We present Generalized LoRA (GLoRA), an advanced approach for universal parameter-efficient fine-tuning tasks. Enhancing Low-Rank Adaptation (LoRA), GLoRA employs a generalized prompt module to optimize pre-trained model weights and adjust intermediate activations, providing more flexibility …