Raul Puri

Large Scale Multi-Actor Generative Dialog Modeling

2020

Non-goal oriented dialog agents (i.e. chatbots) aim to produce varying and engaging conversations with a user; however, they typically exhibit either inconsistent personality across conversations or the average personality of all users. This paper addresses …

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

2019 · arXiv (Cornell University)

Recent work in language modeling demonstrates that training large transformer models advances the state of the art in Natural Language Processing applications. However, very large models can be quite difficult to train due to memory …