Chantal Amrhein

How Suitable Are Subword Segmentation Strategies for Translating Non-Concatenative Morphology?

2021 · arXiv (Cornell University)

Data-driven subword segmentation has become the default strategy for open-vocabulary machine translation and other NLP tasks, but may not be sufficiently generic for optimal learning of non-concatenative morphology. We design a test suite to evaluate …