Sahar Ghannay

mALBERT: Is a Compact Multilingual BERT Model Still Worth It?

2024 · arXiv (Cornell University)

Within the current trend of Pretained Language Models (PLM), emerge more and more criticisms about the ethical andecological impact of such models. In this article, considering these critical remarks, we propose to focus on smallermodels, …

Word Embedding Evaluation and Combination

2016

Word embeddings have been successfully used in several natural language processing tasks (NLP) and speech processing.Different approaches have been introduced to calculate word embeddings through neural networks.In the literature, many studies focused on word embedding …

End-To-End Named Entity And Semantic Concept Extraction From Speech

2018

Named entity recognition (NER) is among SLU tasks that usually extract semantic information from textual documents. Until now, NER from speech is made through a pipeline process that consists in processing first an automatic speech …