Alexey Romanov

GhostWriter: Using an LSTM for Automatic Rap Lyric Generation

2015

This paper demonstrates the effectiveness of a Long Short-Term Memory language model in our initial efforts to generate unconstrained rap lyrics. The goal of this model is to generate lyrics that are similar in style …

Temporal Information Extraction for Question Answering Using Syntactic Dependencies in an LSTM-based Architecture

2017

In this paper, we propose to use a set of simple, uniform in architecture LSTMbased models to recover different kinds of temporal relations from text. Using the shortest dependency path between entities as input, the …

Lessons from Natural Language Inference in the Clinical Domain

2018

State of the art models using deep neural networks have become very good in learning an accurate mapping from inputs to outputs. However, they still lack generalization capabilities in conditions that differ from the ones …

Revealing the Dark Secrets of BERT

2019

Olga Kovaleva, Alexey Romanov, Anna Rogers, Anna Rumshisky. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019.