Researcher profile

Zhenisbek Assylbekov

2 papers in the PaperMetrix corpus

Publications

Papers by this author

  1. Reusing Weights in Subword-Aware Neural Language Models

    2018 · Nazarbayev University Repository (Nazarbayev University)

    The authors introduce methods for reusing subword embeddings and other parameters in subword-aware neural language models. Techniques improve syllable- and morpheme-aware models' performance while greatly reducing model size. A practical principle is identified: when reusing …

  2. Speeding Up Entmax

    2021 · arXiv (Cornell University)

    Softmax is the de facto standard in modern neural networks for language processing when it comes to normalizing logits. However, by producing a dense probability distribution each token in the vocabulary has a nonzero chance …