Berivan Isik

Rate-Distortion Theoretic Model Compression: Successive Refinement for Pruning

2021 · arXiv (Cornell University)

We study the neural network (NN) compression problem, viewing the tension between the compression ratio and NN performance through the lens of rate-distortion theory. We choose a distortion metric that reflects the effect of NN …