Jianhui Li

OpsEval: A Comprehensive IT Operations Benchmark Suite for Large Language Models

2023 · arXiv (Cornell University)

Information Technology (IT) Operations (Ops), particularly Artificial Intelligence for IT Operations (AIOps), is the guarantee for maintaining the orderly and stable operation of existing information systems. According to Gartner's prediction, the use of AI technology …

A Survey on AgentOps: Categorization, Challenges, and Future Directions

2025 · arXiv (Cornell University)

As the reasoning capabilities of Large Language Models (LLMs) continue to advance, LLM-based agent systems offer advantages in flexibility and interpretability over traditional systems, garnering increasing attention. However, despite the widespread research interest and industrial …