On distributing the clustering process

  • Authors:
  • B. Boutsinas;T. Gnardellis

  • Affiliations:
  • Department of Business Administration, University of Patras, and University of Patras Artificial Intelligence Research Center (UPAIRC), and IS & AI Lab, Department of Computer Engineering and Info ...;IS & AI Lab, Department of Computer Engineering and Informatics, GR-26500 Patras, Greece

  • Venue:
  • Pattern Recognition Letters
  • Year:
  • 2002

Quantified Score

Hi-index 0.11

Visualization

Abstract

Clustering algorithms require a large amount of computations of distances among patterns and centers of clusters. Hence, their complexity is dominated by the number of patterns. On the other hand, there is an explosive growth of business or scientific databases storing huge volumes of data. One of the main challenges of today's knowledge discovery systems is their ability to scale up to very large data sets. In this paper, we present a clustering methodology for scaling up any clustering algorithm. It is an iterative process that it is based on partitioning a sample of data into subsets. We, also, present extensive empirical tests that demonstrate the proposed methodology reduces the time complexity and at the same time may maintain the accuracy that would be achieved by a single clustering algorithm supplied with all the data.