Fengyu Sun

Building Optimal Neural Architectures using Interpretable Knowledge

2024 · arXiv (Cornell University)

Neural Architecture Search is a costly practice. The fact that a search space can span a vast number of design choices with each architecture evaluation taking nontrivial overhead makes it hard for an algorithm to …

GLASS: Global-Local Aggregation for Inference-time Sparsification of LLMs

2025 · ArXiv.org

Inference-time sparsification is a promising path to deploy large language models (LLMs) on resource-constrained devices, yet existing training-free methods typically estimate feedforward network (FFN) neuron importance from the input prompt alone. We show this prompt-only …