NeurIPS 2020

Effective Diversity in Population Based Reinforcement Learning

Meta Review

This paper focuses on an interesting problem of maintaining diversity in a set of agents. The paper formalizes the problem clearly, and the initial results presented are positive and support the paper's claims. The paper is fairly well written. Among the aspects of the paper that could be improved upon, the experimental section lacks many details and no ablation studies are performed, it is not clear how the new technique compares from a computational cost perspective, and some of the implications of the assumptions made (e.g., on the scope of problems to which this approach can reasonably be applied) are not clearly stated. Overall, the paper was found to make a sufficient contribution and the final recommendation is to accept. Please take reviewer comments into account as you are preparing the final version.