Steven Basart

Measuring Massive Multitask Language Understanding

2020 · arXiv (Cornell University)

We propose a new test to measure a text model's multitask accuracy. The test covers 57 tasks including elementary mathematics, US history, computer science, law, and more. To attain high accuracy on this test, models …

Measuring Massive Multitask Language Understanding

2021 · International Conference on Learning Representations

We propose a new test to measure a text model's multitask accuracy. The test covers 57 tasks including elementary mathematics, US history, computer science, law, and more. To attain high accuracy on this test, models …