Collaborative adaptive scheduling scheme for multi-source big data tasks in the cloud

With the arrival of big data age, workflow applications are transferring from original infrastructure to more efficient, reliable and affordable cloud computing platforms. Focusing on fine-grained big data tasks schedule in cloud computing environment, we proposed a novel collaborative adaptive algorithm based on reinforcement learning in this paper. Experiment results demonstrate the efficiency of the collaborative adaptive scheduling scheme.