Yuan, Yuan

Federating to Grow Transformers with Constrained Resources without Model Sharing

2024 · arXiv (Cornell University)

The high resource consumption of large-scale models discourages resource-constrained users from developing their customized transformers. To this end, this paper considers a federated framework named Fed-Grow for multiple participants to cooperatively scale a transformer from …

Probing Neural Topology of Large Language Models

2025 · arXiv (Cornell University)

Probing large language models (LLMs) has yielded valuable insights into their internal mechanisms by linking neural activations to interpretable semantics. However, the complex mechanisms that link neuron's functional co-activation with the emergent model capabilities remains …