Egor Shulgin

MAST: Model-Agnostic Sparsified Training

2023 · arXiv (Cornell University)

We introduce a novel optimization problem formulation that departs from the conventional way of minimizing machine learning model loss as a black-box function. Unlike traditional formulations, the proposed approach explicitly incorporates an initially pre-trained model …