NeurIPS 2020

Implicit Bias in Deep Linear Classification: Initialization Scale vs Training Accuracy

Meta Review

All reviewers have found the work well written, technically sound and providing very interesting insights on a simple model that may lead to a better understanding of more complicated models. In particular the connection between the optimization path and the regularization path is insightful, and the numerical experiments nicely illustrate the theory. I thus recommend accept.