Mansour Khelghatdoust

Peacock: Probe-Based Scheduling of Jobs by Rotating Between Elastic Queues

2018 · arXiv (Cornell University)

In this paper, we propose Peacock, a new distributed probe-based scheduler which handles heterogeneous workloads in data analytics frameworks with low latency. Peacock mitigates the \emph{Head-of-Line blocking} problem, i.e., shorter tasks are enqueued behind the …