NeurIPS 2019
Sun Dec 8th through Sat the 14th, 2019 at Vancouver Convention Center
Paper ID:4416
Title:Fast Convergence of Natural Gradient Descent for Over-Parameterized Neural Networks

This paper proves fast convergence of natural gradient descent for over-parameterized neural networks, and its generalization error bound. This paper is on the borderline and was carefully discussed. The main concern is about the novelty of this paper, as well as lack of details in the experiments. The paper gathered some support from the reviewers to merit acceptance, after author response and reviewer discussion. Thus I recommend accept.