Xiaoyi Lu

Performance characterization and acceleration of in-memory file systems for Hadoop and Spark applications on HPC clusters

2015

For data-intensive computing, the low throughput of the existing disk-bound storage systems is a major bottleneck. Recent emergence of the in-memory file systems with heterogeneous storage support mitigates this problem to a great extent. Parallel …

Cutting the Tail: Designing High Performance Message Brokers to Reduce Tail Latencies in Stream Processing

2018

Over the last decade, organizations have become heavily reliant on providing near-instantaneous insights to the end user based on vast amounts of data collected from various sources in real-time. In order to accomplish this task, …

gZCCL: Compression-Accelerated Collective Communication Framework for GPU Clusters

2024

GPU-aware collective communication has become a major bottleneck for modern computing platforms as GPU computing power rapidly rises. A traditional approach is to directly integrate lossy compression into GPU-aware collectives, which can lead to serious …