Karan Aggarwal

Efficient Continual Pre-training for Building Domain Specific Large Language Models

2023 · arXiv (Cornell University)

Large language models (LLMs) have demonstrated remarkable open-domain capabilities. LLMs tailored for a domain are typically trained entirely on domain corpus to excel at handling domain-specific tasks. In this work, we explore an alternative strategy …