conference-paper Open access

Juman++: A Morphological Analysis Toolkit for Scriptio Continua

Research footprint

At a glance

Citations
61
References
6
Comments
0
Paper overview

Abstract

We present a three-part toolkit for developing morphological analyzers for languages without natural word boundaries. The first part is a lattice-based morphological analysis library that uses a combination of linear and recurrent neural net language models for analysis. The other parts are a tool for exposing problems in the trained model and a partial annotation tool. Our morphological analyzer for Japanese achieves new SOTA on Jumandic-based corpora while being 250 times faster than the previous one. We also perform a small experiment and quantitive analysis of using our toolkit.

Record transparency

Publication details

DOI
10.18653/v1/d18-2010
OpenAlex
W2891475925
Document type
conference-paper
Language
EN
Last metadata update
Community

Comments

Log in to join the discussion.

  1. No comments yet. Start the discussion.