Aditya Vempaty

SEAL: Suite for Evaluating API-use of LLMs

2024 · arXiv (Cornell University)

Large language models (LLMs) have limitations in handling tasks that require real-time access to external APIs. While several benchmarks like ToolBench and APIGen have been developed to assess LLMs' API-use capabilities, they often suffer from …