Sébastien Bubeck

Adversarial Examples in Multi-Layer Random ReLU Networks

2021 · arXiv (Cornell University)

We consider the phenomenon of adversarial examples in ReLU networks with independent gaussian parameters. For networks of constant depth and with a large range of widths (for instance, it suffices if the width of each …

TinyGSM: achieving >80% on GSM8k with small language models

2023 · arXiv (Cornell University)

Small-scale models offer various computational advantages, and yet to which extent size is critical for problem-solving abilities remains an open question. Specifically for solving grade school math, the smallest model size so far required to …