Ziyu Zhao

The Stage Model of Intelligent System Forensics

2019 · Journal of Physics Conference Series

Abstract With the rapid development of Internet, mobile communication is moving towards the 5G era, and the application of intelligent systems is in the ascendant. The corresponding intelligent system forensics has become one of the …

Dropping Experts, Recombining Neurons: Retraining-Free Pruning for Sparse Mixture-of-Experts LLMs

2025 · arXiv (Cornell University)

Sparse Mixture-of-Experts (SMoE) architectures are widely used in large language models (LLMs) due to their computational efficiency. However, though only a few experts are activated for each token, SMoE still requires loading all expert parameters, …