Researcher profile
Pedro Moreno Mengibar
2 papers in the PaperMetrix corpus
Publications
Papers by this author
-
Modular Domain Adaptation for Conformer-Based Streaming ASR
2023 · arXiv (Cornell University)
Speech data from different domains has distinct acoustic and linguistic characteristics. It is common to train a single multidomain model such as a Conformer transducer for speech recognition on a mixture of data from all …
-
TransformerFAM: Feedback attention is working memory
2024 · arXiv (Cornell University)
While Transformers have revolutionized deep learning, their quadratic attention complexity hinders their ability to process infinitely long inputs. We propose Feedback Attention Memory (FAM), a novel Transformer architecture that leverages a feedback loop to enable …