Hang Qu

Execution Templates: Caching Control Plane Decisions for Strong Scaling of Data Analytics

2017 · arXiv (Cornell University)

Control planes of cloud frameworks trade off between scheduling granularity and performance. Centralized systems schedule at task granularity, but only schedule a few thousand tasks per second. Distributed systems schedule hundreds of thousands of tasks …