The authors should be commended on writing and submitting a interesting paper on an important topic: adaptive MCMC with an "active" set of samples for estimating a proposal distribution online. The ergodicity theoretical contribution outweighed the deficiencies noted by the reviewers. It would be great if the authors, when working towards the camera-ready, heed the reviewer advice; particularly as it relates to covering related work.