Aviad Sar-Shalom

Dyna-bAbI: unlocking bAbI's potential with dynamic synthetic benchmarking

2021 · arXiv (Cornell University)

While neural language models often perform surprisingly well on natural language understanding (NLU) tasks, their strengths and limitations remain poorly understood. Controlled synthetic tasks are thus an increasingly important resource for diagnosing model behavior. In …