Randy Zakya Suchrady

Entropy2Vec: Crosslingual Language Modeling Entropy as End-to-End Learnable Language Representations

2025 · arXiv (Cornell University)

We introduce Entropy2Vec, a novel framework for deriving cross-lingual language representations by leveraging the entropy of monolingual language models. Unlike traditional typological inventories that suffer from feature sparsity and static snapshots, Entropy2Vec uses the inherent …