The idea of conditionally merging features from different scales in FPN is interesting as acknowledged by all reviewers, and promising results are obtained by the proposed method. The AC agrees with the reviewers that the paper passes the acceptance bar of NeurIPS and recommends acceptance. The authors should add the clarifications and discussion in the rebuttal to the camera-ready version.