Analysis and Improvement of Policy Gradient Estimation - Zhao, Tingting; Hachiya, Hirotaka; Niu, Gang; Sugiyama, Masashi (Advances in Neural Information Processing Systems, 2011)