Zhiyi Fu

HoME: Hierarchy of Multi-Gate Experts for Multi-Task Learning at Kuaishou

2024 · arXiv (Cornell University)

In this paper, we present the practical problems and the lessons learned at short-video services from Kuaishou. In industry, a widely-used multi-task framework is the Mixture-of-Experts (MoE) paradigm, which always introduces some shared and specific …