Improving density-based methods for hierarchical clustering of web pages

  • Authors:
  • Morteza Haghir Chehreghani;Hassan Abolhassani;Mostafa Haghir Chehreghani

  • Affiliations:
  • Faculty of CE, Sharif University of Technology, Tehran 1458889694, Iran;Faculty of CE, Sharif University of Technology, Tehran 1458889694, Iran and School of Computer Science, Institute for Studies in Theoretical Physics and Mathematics (IPM), Niavaran, Tehran 1458889 ...;Faculty of ECE, School of Engineering, University of Tehran, Tehran 1234561234, Iran

  • Venue:
  • Data & Knowledge Engineering
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

The rapid increase of information on the web makes it necessary to improve information management techniques. One of the most important techniques is clustering web data. In this paper, we propose a new 3-phase clustering method that finds dense units in a data set using density-based algorithms. The distances in the dense units are stored in order in structures such as a min heap. In the extraction stage, these distances are extracted one by one, and their effects on the clustering process are examined. Finally, in the combination stage, clustering is completed using improved versions of well-known single and average linkage methods. All steps of the methods are performed in O(nlogn) time complexity. The proposed methods have the benefit of low complexity, and experimental results show they generate clusters with high quality. Other experiments also show that they provide additional advantages, such as clustering by sampling.