Junyu Luo

Hierarchical Pretraining on Multimodal Electronic Health Records

2023 · arXiv (Cornell University)

Pretraining has proven to be a powerful technique in natural language processing (NLP), exhibiting remarkable success in various NLP downstream tasks. However, in the medical domain, existing pretrained models on electronic health records (EHR) fail …