David Sánchez‐Infantes

Entropy and type-token ratio in gigaword corpora

2024 · arXiv (Cornell University)

There are different ways of measuring diversity in complex systems. In particular, in language, lexical diversity is characterized in terms of the type-token ratio and the word entropy. We here investigate both diversity metrics in …