The paper addresses the problem of generalization in POMDPs, and all reviewers agreed that it contains clever ideas which are well evaluated, and so it makes a good contribution. The reviewers also agreed that there are presentation problems that the authors should fix, but that these can be handled in a revision. Hence, I recommend acceptance and very strongly encourage the authors to revise the paper and improve the writing taking into account the detailed comments in the reviews.