This work establishes a link between self-distillation and label smoothing. The reviewers found the idea interesting and, after rebuttal, found the connection correct. However, there remained lingering concerns about the empirical performance of the proposed beta-smoothing approach. Nevertheless, three reviewers found that the other contributions of the paper would be of interest to the NeurIPS community. Therefore, I recommend accept.