Dimitri Fairbrother

Contextual Morphogenesis in Large Language Models: A Novel Approach to Self-Organizing Token Representations

2025 · arXiv (Cornell University)

Token representations influence the efficiency and adaptability of language models, yet conventional tokenization strategies impose rigid segmentation boundaries that do not adjust dynamically to evolving contextual relationships. The introduction of contextual morphogenesis establishes a self-organizing …