Melissa Xiaohui Qin

Revisiting a Pain in the Neck: Semantic Phrase Processing Benchmark for Language Models

2024 · arXiv (Cornell University)

We introduce LexBench, a comprehensive evaluation suite enabled to test language models (LMs) on ten semantic phrase processing tasks. Unlike prior studies, it is the first work to propose a framework from the comparative perspective …