Selection of the number of clusters via the bootstrap method

  • Authors:
  • Yixin Fang;Junhui Wang

  • Affiliations:
  • Division of Biostatistics, Department of Environmental Medicine, New York University, 650 First Avenue, Room 551, New York, NY 10016, United States;Department of Mathematics, Statistics, and Computer Science, University of Illinois at Chicago, United States

  • Venue:
  • Computational Statistics & Data Analysis
  • Year:
  • 2012

Quantified Score

Hi-index 0.03

Visualization

Abstract

Here the problem of selecting the number of clusters in cluster analysis is considered. Recently, the concept of clustering stability, which measures the robustness of any given clustering algorithm, has been utilized in Wang (2010) for selecting the number of clusters through cross validation. In this paper, an estimation scheme for clustering instability is developed based on the bootstrap, and then the number of clusters is selected so that the corresponding estimated clustering instability is minimized. The proposed selection criterion's effectiveness is demonstrated on simulations and real examples.