Feihu Che

DReSS: Data-driven Regularized Structured Streamlining for Large Language Models

2025 · arXiv (Cornell University)

Large language models (LLMs) have achieved significant progress across various domains, but their increasing scale results in high computational and memory costs. Recent studies have revealed that LLMs exhibit sparsity, providing the potential to reduce …