Zihong Zhang

Segment First or Comprehend First? Explore the Limit of Unsupervised Word Segmentation with Large Language Models

2025 · arXiv (Cornell University)

Word segmentation stands as a cornerstone of Natural Language Processing (NLP). Based on the concept of "comprehend first, segment later", we propose a new framework to explore the limit of unsupervised word segmentation with Large …