Luo Mai

Manage the Workloads not the Cluster: Designing a Control Plane for Large-Scale AI Clusters

2025

The rapid adoption of large language model (LLM) services, such as ChatGPT and DeepSeek, has created unprecedented demand for computational resources, particularly on accelerator-equipped clusters (e.g., GPUs, NPUs). These workloads present unique challenges due to …