Ila Fiete

How to Train Your Wide Neural Network Without Backprop: An Input-Weight Alignment Perspective

2021 · arXiv (Cornell University)

Recent works have examined theoretical and empirical properties of wide neural networks trained in the Neural Tangent Kernel (NTK) regime. Given that biological neural networks are much wider than their artificial counterparts, we consider NTK …