All reviewers have found the work well written, technically sound and providing very interesting insights on a simple model that may lead to a better understanding of more complicated models. In particular the connection between the optimization path and the regularization path is insightful, and the numerical experiments nicely illustrate the theory. I thus recommend accept.