Bayesian model-based clustering procedures
- Publication Type:
- Journal Article
- Citation:
- Journal of Computational and Graphical Statistics, 2007, 16 (3), pp. 526 - 558
- Issue Date:
- 2007-09-01
Closed Access
| Filename | Description | Size | |||
|---|---|---|---|---|---|
 | 2010002256OK.pdf | 2.77 MB |
Copyright Clearance Process
- Recently Added
- In Progress
- Closed Access
This item is closed access and not available.
This article establishes a general formulation for Bayesian model-based clustering, in which subset labels are exchangeable, and items are also exchangeable, possibly up to covariate effects. The notational framework is rich enough to encompass a variety of existing procedures, including some recently discussed methods involving stochastic search or hierarchical clustering, but more importantly allows the formulation of clustering procedures that are optimal with respect to a specified loss function. Our focus is on loss functions based on pairwise coincidences, that is, whether pairs of items are clustered into the same subset or not. Optimization of the posterior expected loss function can be formulated as a binary integer programming problem, which can be readily solved by standard software when clustering a modest number of items, but quickly becomes impractical as problem scale increases. To combat this, a new heuristic item-swapping algorithm is introduced. This performs well in our numerical experiments, on both simulated and real data examples. The article includes a comparison of the statistical performance of the (approximate) optimal clustering with earlier methods that are model-based but ad hoc in their detailed definition. © 2007 American Statistical Association, Institute of Mathematical Statistics, and Interface Foundation of North America.
Please use this identifier to cite or link to this item: