Julian Salazar

Robust and Unbounded Length Generalization in Autoregressive Transformer-Based Text-to-Speech

2024 · arXiv (Cornell University)

Autoregressive (AR) Transformer-based sequence models are known to have difficulty generalizing to sequences longer than those seen during training. When applied to text-to-speech (TTS), these models tend to drop or repeat words or produce erratic …