Michael R. Lyu

Title-Guided Encoding for Keyphrase Generation

2018 · arXiv (Cornell University)

Keyphrase generation (KG) aims to generate a set of keyphrases given a document, which is a fundamental task in natural language processing (NLP). Most previous methods solve this problem in an extractive manner, while recently, …

Information Aggregation for Multi-Head Attention with Routing-by-Agreement

2019

Jian Li, Baosong Yang, Zi-Yi Dou, Xing Wang, Michael R. Lyu, Zhaopeng Tu. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long …

NV-DNN: Towards Fault-Tolerant DNN Systems with N-Version Programming

2019

Employing deep learning algorithms in real-world applications becomes a trend. However, a bottleneck that impedes their further adoption in safety-critical systems is the reliability issue. It is challenging to develop reliable neural network models as …

Retrieval-Augmented Multilingual Keyphrase Generation with Retriever-Generator Iterative Training

2022 · Findings of the Association for Computational Linguistics: NAACL 2022

Keyphrase generation is the task of automatically predicting keyphrases given a piece of long text. Despite its recent flourishing, keyphrase generation on non-English languages haven't been vastly investigated. In this paper, we call attention to …

Prism: Revealing Hidden Functional Clusters from Massive Instances in Cloud Systems

2023 · arXiv (Cornell University)

Ensuring the reliability of cloud systems is critical for both cloud vendors and customers. Cloud systems often rely on virtualization techniques to create instances of hardware resources, such as virtual machines. However, virtualization hinders the …

Exploring Multi-Lingual Bias of Large Code Models in Code Generation

2024 · arXiv (Cornell University)

Code generation aims to synthesize code and fulfill functional requirements based on natural language (NL) specifications, which can greatly improve development efficiency. In the era of large language models (LLMs), large code models (LCMs) have …

Fused Matrix Factorization with Geographical and Social Influence in Location-Based Social Networks

2021 · Proceedings of the AAAI Conference on Artificial Intelligence

Recently, location-based social networks (LBSNs), such as Gowalla, Foursquare, Facebook, and Brightkite, etc., have attracted millions of users to share their social friendship and their locations via check-ins. The available check-in information makes it possible …

Generating Distractors for Reading Comprehension Questions from Real Examinations

2018 · arXiv (Cornell University)

We investigate the task of distractor generation for multiple choice reading comprehension questions from examinations. In contrast to all previous works, we do not aim at preparing words or short phrases distractors, instead, we endeavor …

Multi-Head Attention with Disagreement Regularization

2018

Multi-head attention is appealing for the ability to jointly attend to information from different representation subspaces at different positions. In this work, we introduce a disagreement regularization to explicitly encourage the diversity among multiple attention …

Difficulty Controllable Generation of Reading Comprehension Questions

2019

We investigate the difficulty levels of questions in reading comprehension datasets such as SQuAD, and propose a new question generation setting, named Difficulty-controllable Question Generation (DQG). Taking as input a sentence in the reading comprehension …