Guangyuan Ma

Pre-training with Large Language Model-based Document Expansion for Dense Passage Retrieval

2023 · arXiv (Cornell University)

In this paper, we systematically study the potential of pre-training with Large Language Model(LLM)-based document expansion for dense passage retrieval. Concretely, we leverage the capabilities of LLMs for document expansion, i.e. query generation, and effectively …

Dial-MAE: ConTextual Masked Auto-Encoder for Retrieval-based Dialogue Systems

2024

Zhenpeng Su, Xing W, Wei Zhou, Guangyuan Ma, Songlin Hu. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 2024.