Georgios Peikos

Mixture of Experts Approaches in Dense Retrieval Tasks

2025 · arXiv (Cornell University)

Dense Retrieval Models (DRMs) are a prominent development in Information Retrieval (IR). A key challenge with these neural Transformer-based models is that they often struggle to generalize beyond the specific tasks and domains they were …