Xuyang Shen

Scaling Laws for Linear Complexity Language Models

2024 · arXiv (Cornell University)

The interest in linear complexity models for large language models is on the rise, although their scaling capacity remains uncertain. In this study, we present the scaling laws for linear complexity language models to establish …