Pei, Dan

OpsEval: A Comprehensive IT Operations Benchmark Suite for Large Language Models

2023 · arXiv (Cornell University)

Information Technology (IT) Operations (Ops), particularly Artificial Intelligence for IT Operations (AIOps), is the guarantee for maintaining the orderly and stable operation of existing information systems. According to Gartner's prediction, the use of AI technology …