NeurIPS 2020

Prophet Attention: Predicting Attention with Future Attention

Meta Review

All the reviewers agree that the paper is simple and achieves impressive results. R1 found the experimental section to be thorough. R2 and R3 mention that both future and past words should be attended to. R4 presents some prior work that should be incorporated into the paper.