裕二 池谷

Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing

2021 · ACM Transactions on Computing for Healthcare

Pretraining large neural language models, such as BERT, has led to impressive gains on many natural language processing (NLP) tasks. However, most pretraining efforts focus on general domain corpora, such as newswire and Web. A …

Fine-Tuning Large Neural Language Models for Biomedical Natural Language Processing

2021 · arXiv (Cornell University)

Motivation: A perennial challenge for biomedical researchers and clinical practitioners is to stay abreast with the rapid growth of publications and medical notes. Natural language processing (NLP) has emerged as a promising direction for taming …

Don’t Generate, Discriminate: A Proposal for Grounding Language Models to Real-World Environments

2023

A key missing capacity of current language models (LMs) is grounding to real-world environments. Most existing work for grounded language understanding uses LMs to directly generate plans that can be executed in the environment to …