Ron Hoory

Leveraging Unpaired Text Data for Training End-to-End Speech-to-Intent Systems

2020 · arXiv (Cornell University)

Training an end-to-end (E2E) neural network speech-to-intent (S2I) system that directly extracts intents from speech requires large amounts of intent-labeled speech data, which is time consuming and expensive to collect. Initializing the S2I model with …

RNN Transducer Models for Spoken Language Understanding

2021

We present a comprehensive study on building and adapting RNN transducer (RNN-T) models for spoken language understanding (SLU). These end-to-end (E2E) models are constructed in three practical settings: a case where verbatim transcripts are available, …

Speech Emotion Recognition using Self-Supervised Features

2022 · arXiv (Cornell University)

Self-supervised pre-trained features have consistently delivered state-of-art results in the field of natural language processing (NLP); however, their merits in the field of speech emotion recognition (SER) still need further investigation. In this paper we …