Tianyi Liu

Toward Deeper Understanding of Nonconvex Stochastic Optimization with Momentum using Diffusion Approximations.

2018 · arXiv (Cornell University)

Momentum Stochastic Gradient Descent (MSGD) algorithm has been widely applied to many nonconvex optimization problems in machine learning. Popular examples include training deep neural networks, dimensionality reduction, and etc. Due to the lack of convexity …

Improving Abstractive Document Summarization with Salient Information Modeling

2019

Comprehensive document encoding and salient information selection are two major difficulties for generating summaries with adequate salient information. To tackle the above difficulties, we propose a Transformerbased encoder-decoder framework with two novel extensions for abstractive …