Yizhou Shan

Skadi: Building a Distributed Runtime for Data Systems in Disaggregated Data Centers

2023

Data-intensive systems are the backbone of today's computing and are responsible for shaping data centers. Over the years, cloud providers have relied on three principles to maintain cost-effective data systems: use disaggregation to decouple scaling, …

DeepServe: Serverless Large Language Model Serving at Scale

2025 · arXiv (Cornell University)

In this paper, we propose DEEPSERVE, a scalable and serverless AI platform designed to efficiently serve large language models (LLMs) at scale in cloud environments. DEEPSERVE addresses key challenges such as resource allocation, serving efficiency, …