Michael Albada

ExCyTIn-Bench: Evaluating LLM agents on Cyber Threat Investigation

2025 · arXiv (Cornell University)

We present ExCyTIn-Bench, the first benchmark to Evaluate an LLM agent X on the task of Cyber Threat Investigation through security questions derived from investigation graphs. Real-world security analysts must sift through a large number …