NeurIPS 2020

RL Unplugged: A Collection of Benchmarks for Offline Reinforcement Learning

Meta Review

This paper presents a benchmark suite for offline RL, along with baseline results on this suite. There is a clear need for such a benchmark suite and all reviewers agree that this submission is a good first step towards fulfilling this need. Only R3 considers that it is not ready yet for acceptance, due to lacking more realistic benchmarks (i.e. closer to complex real world industrial applications). Although I agree that this is a valid concern (and I encourage the authors to follow R3’s advice and look up potential simulators that may fill up this gap), I also agree with other reviewers that the current state of the proposed benchmark should already be very useful to the research community. As a result, I recommend to accept this paper.