Ronen Eldan

TinyGSM: achieving >80% on GSM8k with small language models

2023 · arXiv (Cornell University)

Small-scale models offer various computational advantages, and yet to which extent size is critical for problem-solving abilities remains an open question. Specifically for solving grade school math, the smallest model size so far required to …