preprint Open access

Extracting Lexical Features from Dialects via Interpretable Dialect Classifiers

  • arXiv (Cornell University)
  • Cornell University
Research footprint

At a glance

Citations
1
References
0
Comments
0
Paper overview

Abstract

Identifying linguistic differences between dialects of a language often requires expert knowledge and meticulous human analysis. This is largely due to the complexity and nuance involved in studying various dialects. We present a novel approach to extract distinguishing lexical features of dialects by utilizing interpretable dialect classifiers, even in the absence of human experts. We explore both post-hoc and intrinsic approaches to interpretability, conduct experiments on Mandarin, Italian, and Low Saxon, and experimentally demonstrate that our method successfully identifies key language-specific lexical features that contribute to dialectal variations.

Record transparency

Publication details

DOI
10.48550/arxiv.2402.17914
OpenAlex
W4393213912
Document type
preprint
Language
EN
Source
arXiv (Cornell University)
Last metadata update
Community

Comments

Log in to join the discussion.

  1. No comments yet. Start the discussion.