Junnan Zhu

Other Roles Matter! Enhancing Role-Oriented Dialogue Summarization via Role Interactions

2022 · arXiv (Cornell University)

Role-oriented dialogue summarization is to generate summaries for different roles in the dialogue, e.g., merchants and consumers. Existing methods handle this task by summarizing each role's content separately and thus are prone to ignore the …

Multi-modal Summarization for Asynchronous Collection of Text, Image, Audio and Video

2017

The rapid increase in multimedia data transmission over the Internet necessitates the multi-modal summarization (MMS) from collections of text, image, audio and video. In this work, we propose an extractive multi-modal summarization method that can …

Multi-modal Sentence Summarization with Modality Attention and Image Filtering

2018

In this paper, we introduce a multi-modal sentence summarization task that produces a short summary from a pair of sentence and image. This task is more challenging than sentence summarization. It not only needs to …