Steven W. Su

Overcoming Multi-Model Forgetting in One-Shot NAS With Diversity Maximization

2020

One-Shot Neural Architecture Search (NAS) significantly improves the computational efficiency through weight sharing. However, this approach also introduces multi-model forgetting during the supernet training (architecture search phase), where the performance of previous architectures degrade when …