Reviewers are not entirely satisfied with your response, however, they are leaning to a positive overall opinion. Hence I think your paper can be accepted provided (and I am really trusting on you, as there is no way to obligue you) you commit to address in as much as possible the open issues raised by reviewers. In particular, please be extra-careful with the proofs and theoretical analysis of your paper, this is critical for your reputation and that of NeurIPS.