Shadi Ibrahim

Chronos: Failure-aware scheduling in shared Hadoop clusters

2015

Hadoop emerged as the de facto state-of-the-art system for MapReduce-based data analytics. The reliability of Hadoop systems depends in part on how well they handle failures. Currently, Hadoop handles machine failures by re-executing all the …

On the Performance of Spark on HPC Systems: Towards a Complete Picture

2018 · Lecture notes in computer science

Big Data analytics frameworks (e.g., Apache Hadoop and Apache Spark) have been increasingly used by many companies and research labs to facilitate large-scale data analysis. However, with the growing needs of users and size of …