David H. P. Turban

Offline bilingual word vectors, orthogonal transformations and the inverted softmax

2017 · arXiv (Cornell University)

Usually bilingual word vectors are trained "online". Mikolov et al. showed they can also be found "offline", whereby two pre-trained embeddings are aligned with a linear transformation, using dictionaries compiled from expert knowledge. In this …