Jian Luo

Dropout Regularization for Self-Supervised Learning of Transformer Encoder Speech Representation

2021

Predicting the altered acoustic frames is an effective way of self-supervised learning for speech representation.However, it is challenging to prevent the pretrained model from overfitting.In this paper, we proposed to introduce two dropout regularization methods …

Towards Robust Dense Retrieval via Local Ranking Alignment

2022

Dense retrieval (DR) has extended the employment of pre-trained language models, like BERT, for text ranking. However, recent studies have raised the robustness issue of DR model against query variations, like query with typos, along …