Ryan Y. Benmalek

Keeping Notes: Conditional Natural Language Generation with a Scratchpad Encoder

2019

We introduce the Scratchpad Mechanism, a novel addition to the sequence-to-sequence (seq2seq) neural network architecture and demonstrate its effectiveness in improving the overall fluency of seq2seq models for natural language generation tasks. By enabling the …

Unsupervised Learning of Dense Visual Representations

2020 · arXiv (Cornell University)

Contrastive self-supervised learning has emerged as a promising approach to unsupervised visual representation learning. In general, these methods learn global (image-level) representations that are invariant to different views (i.e., compositions of data augmentation) of the …