Zehuan Wang

Accelerating Sparse DNN Models without Hardware-Support via Tile-Wise Sparsity

2020

Network pruning can reduce the high computation cost of deep neural network (DNN) models. However, to maintain their accuracies, sparse models often carry randomly-distributed weights, leading to irregular computations. Consequently, sparse models cannot achieve meaningful …

A GPU-specialized Inference Parameter Server for Large-Scale Deep Recommendation Models

2022

Recommendation systems are of crucial importance for a variety of modern apps and web services, such as news feeds, social networks, e-commerce, search, etc. To achieve peak prediction accuracy, modern recommendation models combine deep learning …