Xuanzhe Liu

FaaSLight: General Application-Level Cold-Start Latency Optimization for Function-as-a-Service in Serverless Computing

2022 · arXiv (Cornell University)

Serverless computing is a popular cloud computing paradigm that frees developers from server management. Function-as-a-Service (FaaS) is the most popular implementation of serverless computing, representing applications as event-driven and stateless functions. However, existing studies report …

FLASH: Heterogeneity-Aware Federated Learning at Scale

2022 · IEEE Transactions on Mobile Computing

Federated learning (FL) becomes a promising machine learning paradigm. The impact of heterogeneous hardware specifications and dynamic states on the FL process has not yet been studied systematically. This paper presents the first large-scale study …

LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism

2024

The context window of large language models (LLMs) is rapidly increasing, leading to a huge variance in resource usage between different requests as well as between different phases of the same request. Restricted by static …