Yanfei Guo

Mimir: Memory-Efficient and Scalable MapReduce for Large Supercomputing Systems

2017

In this paper we present Mimir, a new implementation of MapReduce over MPI. Mimir inherits the core principles of existing MapReduce frameworks, such as MR-MPI, while redesigning the execution model to incorporate a number of …

gZCCL: Compression-Accelerated Collective Communication Framework for GPU Clusters

2024

GPU-aware collective communication has become a major bottleneck for modern computing platforms as GPU computing power rapidly rises. A traditional approach is to directly integrate lossy compression into GPU-aware collectives, which can lead to serious …