Hope, Tom

Parameter-Efficient Fine-Tuning of LLaMA for the Clinical Domain

2023 · arXiv (Cornell University)

Adapting pretrained language models to novel domains, such as clinical applications, traditionally involves retraining their entire set of parameters. Parameter-Efficient Fine-Tuning (PEFT) techniques for fine-tuning language models significantly reduce computational requirements by selectively fine-tuning small …