Chuan Wu

Deep Learning-based Job Placement in Distributed Machine Learning Clusters

2019

Production machine learning (ML) clusters commonly host a variety of distributed ML workloads, e.g., speech recognition, machine translation. While server sharing among jobs improves resource utilization, interference among co-located ML jobs can lead to significant …

GADGET: Online Resource Optimization for Scheduling Ring-All-Reduce Learning Jobs

2022

Fueled by advances in distributed deep learning (DDL), recent years have witnessed a rapidly growing demand for resource-intensive distributed/parallel computing to process DDL computing jobs. To resolve network communication bottleneck and load balancing issues in …