The reviewers agree that the paper made a significant contribution using the relevance gating mechanism mechanism to enhance the design of neural power unit. Empirical studies further support the power of NPU. Moreover, the trade off between interpretability and convergence is well-explained.