Parallel Sampling of HDPs using Sub-Cluster Splits

Jason Chang; John W. Fisher III

Parallel Sampling of HDPs using Sub-Cluster Splits

Part of: Advances in Neural Information Processing Systems 27 (NIPS 2014)

[PDF] [BibTeX] [Supplemental] [Reviews]

Authors

Jason Chang
John W. Fisher III

Conference Event Type: Poster

Abstract

We develop a sampling technique for Hierarchical Dirichlet process models. The parallel algorithm builds upon [Chang & Fisher 2013] by proposing large split and merge moves based on learned sub-clusters. The additional global split and merge moves drastically improve convergence in the experimental results. Furthermore, we discover that cross-validation techniques do not adequately determine convergence, and that previous sampling methods converge slower than were previously expected.