Igor T. Podolak

Zero Time Waste: Recycling Predictions in Early Exit Neural Networks

2021 · arXiv (Cornell University)

The problem of reducing processing time of large deep learning models is a fundamental challenge in many real-world applications. Early exit methods strive towards this goal by attaching additional Internal Classifiers (ICs) to intermediate layers …