Shaohan Huang
7 أوراق في مجموعة PaperMetrix
أوراق هذا المؤلف
-
Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment
2021 · arXiv (Cornell University)
The cross-lingual language models are typically pretrained with masked language modeling on multilingual text or parallel sentences. In this paper, we introduce denoising word alignment as a new cross-lingual pre-training task. Specifically, the model first …
-
MoEC: Mixture of Expert Clusters
2022 · arXiv (Cornell University)
Sparsely Mixture of Experts (MoE) has received great interest due to its promising scaling capability with affordable computational overhead. MoE converts dense layers into sparse experts, and utilizes a gated routing network to make experts …
-
Text Morphing
2018 · arXiv (Cornell University)
In this paper, we introduce a novel natural language generation task, termed as text morphing, which targets at generating the intermediate sentences that are fluency and smooth with the two input sentences. We propose the …
-
HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decomposition
2024
Yuxuan Liu, Tianchi Yang, Shaohan Huang, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.
-
Neural Document Summarization by Jointly Learning to Score and Select Sentences
2018
Sentence scoring and sentence selection are two main steps in extractive document summarization systems. However, previous works treat them as two separated subtasks. In this paper, we present a novel end-to-end neural network framework for …
-
Response Generation by Context-Aware Prototype Editing
2019 · Proceedings of the AAAI Conference on Artificial Intelligence
Open domain response generation has achieved remarkable progress in recent years, but sometimes yields short and uninformative responses. We propose a new paradigm, prototypethen-edit for response generation, that first retrieves a prototype response from a …
-
PromptBERT: Improving BERT Sentence Embeddings with Prompts
2022
Ting Jiang, Jian Jiao, Shaohan Huang, Zihan Zhang, Deqing Wang, Fuzhen Zhuang, Furu Wei, Haizhen Huang, Denvy Deng, Qi Zhang. Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing. 2022.