Baevski, Alexei

In-Kernel Aggregation and Broadcast Acceleration for Distributed Communication

2020 · arXiv (Cornell University)

Broadcasting and aggregation dominate the communication overhead in distributed systems, from machine learning training to data analytics. Current acceleration approaches require specialized hardware (RDMA) or dedicated resources (DPDK), limiting their deployment in commodity clouds. However, …