Keith G. Mills

L2NAS

2021

Neural architecture search (NAS) has achieved remarkable results in deep neural network design. Differentiable architecture search converts the search over discrete architectures into a hyperparameter optimization problem which can be solved by gradient descent. However, …

Building Optimal Neural Architectures using Interpretable Knowledge

2024 · arXiv (Cornell University)

Neural Architecture Search is a costly practice. The fact that a search space can span a vast number of design choices with each architecture evaluation taking nontrivial overhead makes it hard for an algorithm to …