Jonathan Frankle

Comparing Rewinding and Fine-tuning in Neural Network Pruning

2020 · arXiv (Cornell University)

Many neural network pruning algorithms proceed in three steps: train the network to completion, remove unwanted structure to compress the network, and retrain the remaining structure to recover lost accuracy. The standard retraining technique, fine-tuning, …