Chengjie Sun

Pre-training Language Models with Deterministic Factual Knowledge

2022 · arXiv (Cornell University)

Previous works show that Pre-trained Language Models (PLMs) can capture factual knowledge. However, some analyses reveal that PLMs fail to perform it robustly, e.g., being sensitive to the changes of prompts when extracting factual knowledge. …

Learning Natural Language Inference using Bidirectional LSTM model and Inner-Attention

2016 · arXiv (Cornell University)

In this paper, we proposed a sentence encoding-based model for recognizing text entailment. In our approach, the encoding of sentence is a two-stage process. Firstly, average pooling was used over word-level bidirectional LSTM (biLSTM) to …