Aston Zhang

Entropy-Based Subword Mining with an Application to Word Embeddings

2018

Recent literature has shown a wide variety of benefits to mapping traditional onehot representations of words and phrases to lower-dimensional real-valued vectors known as word embeddings. Traditionally, most word embedding algorithms treat each word as …

Simple and Effective Curriculum Pointer-Generator Networks for Reading Comprehension over Long Narratives

2019 · arXiv (Cornell University)

This paper tackles the problem of reading comprehension over long narratives where documents easily span over thousands of tokens. We propose a curriculum learning (CL) based Pointer-Generator framework for reading/sampling over large documents, enabling diverse …

Automatic Chain of Thought Prompting in Large Language Models

2022 · arXiv (Cornell University)

Large language models (LLMs) can perform complex reasoning by generating intermediate reasoning steps. Providing these steps for prompting demonstrations is called chain-of-thought (CoT) prompting. CoT prompting has two major paradigms. One leverages a simple prompt …

Is ChatGPT a General-Purpose Natural Language Processing Task Solver?

2023

Spurred by advancements in scale, large language models (LLMs) have demonstrated the ability to perform a variety of natural language processing (NLP) tasks zero-shot—i.e., without adaptation on downstream data. Recently, the debut of ChatGPT has …