Ru Shu Peng

DataMan: Data Manager for Pre-training Large Language Models

2025 · arXiv (Cornell University)

The performance emergence of large language models (LLMs) driven by data scaling laws makes the selection of pre-training data increasingly important. However, existing methods rely on limited heuristics and human intuition, lacking comprehensive and clear …