Hongyi Yuan

BioBART: Pretraining and Evaluation of A Biomedical Generative Language Model

2022 · arXiv (Cornell University)

Pretrained language models have served as important backbones for natural language processing. Recently, in-domain pretraining has been shown to benefit various domain-specific downstream tasks. In the biomedical domain, natural language generation (NLG) tasks are of …

How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition

2024

Guanting Dong, Hongyi Yuan, Keming Lu, Chengpeng Li, Mingfeng Xue, Dayiheng Liu, Wei Wang, Zheng Yuan, Chang Zhou, Jingren Zhou. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long …