Yipeng Shen

KVFlow: Efficient Prefix Caching for Accelerating LLM-Based Multi-Agent Workflows

2025

Large language model (LLM) based agentic workflows have become a popular paradigm for coordinating multiple specialized agents to solve complex tasks. To improve serving efficiency, existing LLM systems employ prefix caching to reuse key-value (KV) …