preprint Open access

Discriminating between similar languages in Twitter using label propagation

  • arXiv (Cornell University)
  • Cornell University
Research footprint

At a glance

Citations
4
References
8
Comments
0
Paper overview

Abstract

Identifying the language of social media messages is an important first step in linguistic processing. Existing models for Twitter focus on content analysis, which is successful for dissimilar language pairs. We propose a label propagation approach that takes the social graph of tweet authors into account as well as content to better tease apart similar languages. This results in state-of-the-art shared task performance of $76.63\%$, $1.4\%$ higher than the top system.

Record transparency

Publication details

DOI
10.48550/arxiv.1607.05408
OpenAlex
W2505556938
Document type
preprint
Language
EN
Source
arXiv (Cornell University)
Last metadata update
Community

Comments

Log in to join the discussion.

  1. No comments yet. Start the discussion.