Researcher profile
Zhenisbek Assylbekov
2 papers in the PaperMetrix corpus
Publications
Papers by this author
-
Reusing Weights in Subword-Aware Neural Language Models
2018 · Nazarbayev University Repository (Nazarbayev University)
The authors introduce methods for reusing subword embeddings and other parameters in subword-aware neural language models. Techniques improve syllable- and morpheme-aware models' performance while greatly reducing model size. A practical principle is identified: when reusing …
-
Speeding Up Entmax
2021 · arXiv (Cornell University)
Softmax is the de facto standard in modern neural networks for language processing when it comes to normalizing logits. However, by producing a dense probability distribution each token in the vocabulary has a nonzero chance …