O'brien, Phillip

WiggleGPT: Revisiting the Monotonicity Assumption in Neural Networks via Oscillating Activation Functions

2025 · Zenodo (CERN European Organization for Nuclear Research)

WiggleGPT: Revisiting the Monotonicity Assumption in Neural Networks via Oscillating Activation Functions Since Minsky and Papert's Perceptrons (1969), artificial neural networks have relied on monotonic activation functions (Sigmoid, ReLU, GELU). This design choice requires multiple …