Bo Ji

GADGET: Online Resource Optimization for Scheduling Ring-All-Reduce Learning Jobs

2022

Fueled by advances in distributed deep learning (DDL), recent years have witnessed a rapidly growing demand for resource-intensive distributed/parallel computing to process DDL computing jobs. To resolve network communication bottleneck and load balancing issues in …