Katayoun Farrahi

Improving the Robustness of Neural Multiplication Units with Reversible Stochasticity

2022 · arXiv (Cornell University)

Multilayer Perceptrons struggle to learn certain simple arithmetic tasks. Specialist neural modules for arithmetic can outperform classical architectures with gains in extrapolation, interpretability and convergence speeds, but are highly sensitive to the training range. In …