Fenglong Xie

A Multi-Stage Multi-Codebook VQ-VAE Approach to High-Performance Neural TTS

2022 · arXiv (Cornell University)

We propose a Multi-Stage, Multi-Codebook (MSMC) approach to high-performance neural TTS synthesis. A vector-quantized, variational autoencoder (VQ-VAE) based feature analyzer is used to encode Mel spectrograms of speech training data by down-sampling progressively in multiple …