Zhaojuan Bian

Simulating Spark Cluster for Deployment Planning, Evaluation and Optimization

2016

As the most active project in the Hadoop ecosystem these days (Zaharia, 2014), Spark is a fast and general purpose engine for large-scale data processing. Thanks to its advanced Directed Acyclic Graph (DAG) execution engine …

Adaptive Cloud Application Tuning with Enhanced Structural Bayesian Optimization

2019

Bayesian optimization has been widely applied on the performance tuning for workloads such as: large web applications running on Java Virtual Machine (JVM), parallel databases such as Hive / HBase, and Hive on Spark. However, …