Yinqiao Li

Learning Architectures from an Extended Search Space for Language Modeling

2020

Neural architecture search (NAS) has advanced significantly in recent years but most NAS systems restrict search to learning architectures of a recurrent or convolutional cell. In this paper, we extend the search space of NAS. …

The NiuTrans System for WNGT 2020 Efficiency Task

2021 · arXiv (Cornell University)

This paper describes the submissions of the NiuTrans Team to the WNGT 2020 Efficiency Shared Task. We focus on the efficient implementation of deep Transformer models \cite{wang-etal-2019-learning, li-etal-2019-niutrans} using NiuTensor (https://github.com/NiuTrans/NiuTensor), a flexible toolkit for …

Multi-layer Representation Fusion for Neural Machine Translation

2020 · arXiv (Cornell University)

Neural machine translation systems require a number of stacked layers for deep models. But the prediction depends on the sentence representation of the top-most layer with no access to low-level representations. This makes it more …