Sicheng Feng

Is Oracle Pruning the True Oracle?

2024 · arXiv (Cornell University)

Oracle pruning, which selects unimportant weights by minimizing the pruned train loss, has served as the foundation for most neural network pruning methods for over thirty-five years, while few (if any) have thought about how …