Vineet Gandhi

ParrotTTS: Text-to-Speech synthesis by exploiting self-supervised representations

2023 · arXiv (Cornell University)

We present ParrotTTS, a modularized text-to-speech synthesis model leveraging disentangled self-supervised speech representations. It can train a multi-speaker variant effectively using transcripts from a single speaker. ParrotTTS adapts to a new language in low resource …

Towards Improving NAM-to-Speech Synthesis Intelligibility using Self-Supervised Speech Models

2024 · arXiv (Cornell University)

We propose a novel approach to significantly improve the intelligibility in the Non-Audible Murmur (NAM)-to-speech conversion task, leveraging self-supervision and sequence-to-sequence (Seq2Seq) learning techniques. Unlike conventional methods that explicitly record ground-truth speech, our methodology relies …