NeurIPS 2020

Stochasticity of Deterministic Gradient Descent: Large Learning Rate for Multiscale Objective Function

Meta Review

Before the author response, all the reviewers seem agree that the results were quite interesting (and I agree), but had a concern about the connection to ML. The author response included examples which mostly addressed this concern, so two reviewers recommended acceptance, while another (reviewer 1) recommended rejection, but was borderline. However, I feel the remaining concerns by reviewer 1 are rather minor.