Alexandra Chronopoulou

Efficient Hierarchical Domain Adaptation for Pretrained Language Models

2021 · arXiv (Cornell University)

The remarkable success of large language models has been driven by dense models trained on massive unlabeled, unstructured corpora. These corpora typically contain text from diverse, heterogeneous sources, but information about the source of the …