Sunita Sarawagi

Topic Sensitive Attention on Generic Corpora Corrects Sense Bias in Pretrained Embeddings

2019

Given a small corpus D T pertaining to a limited set of focused topics, our goal is to train embeddings that accurately capture the sense of words in the topic in spite of the limited …

Overlap-based Vocabulary Generation Improves Cross-lingual Transfer Among Related Languages

2022 · arXiv (Cornell University)

Pre-trained multilingual language models such as mBERT and XLM-R have demonstrated great potential for zero-shot cross-lingual transfer to low web-resource languages (LRL). However, due to limited model capacity, the large difference in the sizes of …

Improving RNN-Transducers with Acoustic LookAhead

2023 · arXiv (Cornell University)

RNN-Transducers (RNN-Ts) have gained widespread acceptance as an end-to-end model for speech to text conversion because of their high accuracy and streaming capabilities. A typical RNN-T independently encodes the input audio and the text context, …