The paper has been well received by all reviews and I find the contribution very interesting as it tries to shed some light to better understand the role of gating in DNNs. The mathematical formulations are strong and detailed as well, which is a plus. There are few typos and some details with the text that should be fixed, the work of Fiat et al. should be clearly cited as well. Some better explanation of the ablation seems that would have been desirable, although I leave to the author to consider whether space allows for better wording.