Roman Kail

Embedded Ensembles: Infinite Width Limit and Operating Regimes

2022 · arXiv (Cornell University)

A memory efficient approach to ensembling neural networks is to share most weights among the ensembled models by means of a single reference network. We refer to this strategy as Embedded Ensembling (EE); its particular …