Rustem Takhanov

Reusing Weights in Subword-Aware Neural Language Models

2018 · Nazarbayev University Repository (Nazarbayev University)

The authors introduce methods for reusing subword embeddings and other parameters in subword-aware neural language models. Techniques improve syllable- and morpheme-aware models' performance while greatly reducing model size. A practical principle is identified: when reusing …