Zhouhan Lin

A Structured Self-Attentive Sentence Embedding.

2017 · International Conference on Learning Representations

This paper proposes a new model for extracting an interpretable sentence embedding by introducing self-attention. Instead of using a vector, we use a 2-D matrix to represent the embedding, with each row of the matrix …

Revisit Systematic Generalization via Meaningful Learning

2020 · arXiv (Cornell University)

Humans can systematically generalize to novel compositions of existing concepts. Recent studies argue that neural networks appear inherently ineffective in such cognitive capacity, leading to a pessimistic view and a lack of attention to optimistic …