David R. So

Evolving modular neural sequence architectures with genetic programming

2018 · Proceedings of the Genetic and Evolutionary Computation Conference Companion

Automated architecture search has demonstrated significant success for image data, where reinforcement learning and evolution approaches now outperform the best human designed networks ([12], [8]). These successes have not transferred over to models dealing with …

Towards a Human-like Open-Domain Chatbot

2020 · arXiv (Cornell University)

We present Meena, a multi-turn open-domain chatbot trained end-to-end on data mined and filtered from public domain social media conversations. This 2.6B parameter neural network is simply trained to minimize perplexity of the next token. …