conference-paper
Open access
Juman++: A Morphological Analysis Toolkit for Scriptio Continua
Research footprint
At a glance
- Citations
- 61
- References
- 6
- Comments
- 0
Paper overview
Abstract
We present a three-part toolkit for developing morphological analyzers for languages without natural word boundaries. The first part is a lattice-based morphological analysis library that uses a combination of linear and recurrent neural net language models for analysis. The other parts are a tool for exposing problems in the trained model and a partial annotation tool. Our morphological analyzer for Japanese achieves new SOTA on Jumandic-based corpora while being 250 times faster than the previous one. We also perform a small experiment and quantitive analysis of using our toolkit.
Record transparency
Publication details
- DOI
- 10.18653/v1/d18-2010
- OpenAlex
- W2891475925
- Document type
- conference-paper
- Language
- EN
- Last metadata update
Comments
Log in to join the discussion.