Yikuan Li

A comparative study of pretrained language models for long clinical text

2022 · Journal of the American Medical Informatics Association

OBJECTIVE: Clinical knowledge-enriched transformer models (eg, ClinicalBERT) have state-of-the-art results on clinical natural language processing (NLP) tasks. One of the core limitations of these transformer models is the substantial memory consumption due to their full …