Christophe Servan

MultiVec: a Multilingual and Multilevel Representation Learning Toolkit for NLP

2016

We present MultiVec, a new toolkit for computing continuous representations for text at different granularity levels (word-level or sequences of words).MultiVec includes Mikolov et al. [2013b]'s word2vec features, Le and Mikolov [2014]'s paragraph vector (batch …

mALBERT: Is a Compact Multilingual BERT Model Still Worth It?

2024 · arXiv (Cornell University)

Within the current trend of Pretained Language Models (PLM), emerge more and more criticisms about the ethical andecological impact of such models. In this article, considering these critical remarks, we propose to focus on smallermodels, …

Listen and Translate: A Proof of Concept for End-to-End Speech-to-Text Translation

2016 · arXiv (Cornell University)

This paper proposes a first attempt to build an end-to-end speech-to-text translation system, which does not use source language transcription during learning or decoding. We propose a model for direct speech-to-text translation, which gives promising …