Gen Xu

Simulating Spark Cluster for Deployment Planning, Evaluation and Optimization

2016

As the most active project in the Hadoop ecosystem these days (Zaharia, 2014), Spark is a fast and general purpose engine for large-scale data processing. Thanks to its advanced Directed Acyclic Graph (DAG) execution engine …