Lin, Weixiong

Squeeze Out Tokens from Sample for Finer-Grained Data Governance

2025 · arXiv (Cornell University)

Widely observed data scaling laws, in which error falls off as a power of the training size, demonstrate the diminishing returns of unselective data expansion. Hence, data governance is proposed to downsize datasets through pruning …