Zhang, Youling

Improved Methods for Model Pruning and Knowledge Distillation

2025 · arXiv (Cornell University)

Model pruning is a performance optimization technique for large language models like R1 or o3-mini. However, existing pruning methods often lead to significant performance degradation or require extensive retraining and fine-tuning. This technique aims to …