Anh‐Duc Vu

Effects of sub-word segmentation on performance of transformer language models

2023 · arXiv (Cornell University)

Language modeling is a fundamental task in natural language processing, which has been thoroughly explored with various architectures and hyperparameters. However, few studies focus on the effect of sub-word segmentation on the performance of language …