Wenbin Jiang

$gen$CNN: A Convolutional Architecture for Word Sequence Prediction

2015 · arXiv (Cornell University)

We propose a novel convolutional architecture, named $gen$CNN, for word sequence prediction. Different from previous work on neural network-based language modeling and generation (e.g., RNN or LSTM), we choose not to greedily summarize the history …

Neural Knowledge Bank for Pretrained Transformers

2022 · arXiv (Cornell University)

The ability of pretrained Transformers to remember factual knowledge is essential but still limited for existing models. Inspired by existing work that regards Feed-Forward Networks (FFNs) in Transformers as key-value memories, we design a Neural …