Jamie Hall

Towards a Human-like Open-Domain Chatbot

2020 · arXiv (Cornell University)

We present Meena, a multi-turn open-domain chatbot trained end-to-end on data mined and filtered from public domain social media conversations. This 2.6B parameter neural network is simply trained to minimize perplexity of the next token. …

LaMDA: Language Models for Dialog Applications

2022 · arXiv (Cornell University)

We present LaMDA: Language Models for Dialog Applications. LaMDA is a family of Transformer-based neural language models specialized for dialog, which have up to 137B parameters and are pre-trained on 1.56T words of public dialog …