Jiaqi Mu

All-but-the-Top: Simple and Effective Postprocessing for Word Representations

2017 · arXiv (Cornell University)

Real-valued word representations have transformed NLP applications; popular examples are word2vec and GloVe, recognized for their ability to capture linguistic regularities. In this paper, we demonstrate a {\em very simple}, and yet counter-intuitive, postprocessing technique …