Hao Kang

FLAME-MoE: A Transparent End-to-End Research Platform for Mixture-of-Experts Language Models

2025 · arXiv (Cornell University)

Recent large language models such as Gemini-1.5, DeepSeek-V3, and Llama-4 increasingly adopt Mixture-of-Experts (MoE) architectures, which offer strong efficiency-performance trade-offs by activating only a fraction of the model per token. Yet academic researchers still lack …