Dayiheng Liu
4 papers in the PaperMetrix corpus
Papers by this author
-
KGR^4: Retrieval, Retrospect, Refine and Rethink for Commonsense Generation
2021 · arXiv (Cornell University)
Generative commonsense reasoning requires machines to generate sentences describing an everyday scenario given several concepts, which has attracted much attention recently. However, existing models cannot perform as well as humans, since sentences they produce are …
-
Noisy Pair Corrector for Dense Retrieval
2023
Most dense retrieval models contain an implicit assumption: the training query-document pairs are exactly matched. Since it is expensive to annotate the corpus manually, training pairs in real-world applications are usually collected automatically, which inevitably …
-
How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition
2024
Guanting Dong, Hongyi Yuan, Keming Lu, Chengpeng Li, Mingfeng Xue, Dayiheng Liu, Wei Wang, Zheng Yuan, Chang Zhou, Jingren Zhou. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long …
-
DataMan: Data Manager for Pre-training Large Language Models
2025 · arXiv (Cornell University)
The performance emergence of large language models (LLMs) driven by data scaling laws makes the selection of pre-training data increasingly important. However, existing methods rely on limited heuristics and human intuition, lacking comprehensive and clear …