Zonghuai Guo

An Improved Speculative Strategy for Heterogeneous Spark Cluster

2018 · MATEC Web of Conferences

Apache Spark is an open-source in-memory cluster-computing framework. Spark decomposes an application into numerous tasks and assigns them to computing nodes for higher efficiency. However, in heterogeneous environments, some tasks become stragglers because of poor …