Clustering web documents using hierarchical representation with multi-granularity

  • Authors:
  • Faliang Huang;Shichao Zhang;Minghua He;Xindong Wu

  • Affiliations:
  • Faculty of Software, Fujian Normal University, Fuzhou, China 350007;College of Computer Science and IT, Guangxi Normal University, Guilin, China 541004 and Faculty of Engineering and Information Technology, UTS, Broadway, Australia 2007;Computer Science, Aston University, Birmingham, United Kingdom B4 7ET;Department of Computer Science, University of Vermont, Burlington, USA 05405

  • Venue:
  • World Wide Web
  • Year:
  • 2014

Quantified Score

Hi-index 0.00

Visualization

Abstract

Web document cluster analysis plays an important role in information retrieval by organizing large amounts of documents into a small number of meaningful clusters. Traditional web document clustering is based on the Vector Space Model (VSM), which takes into account only two-level (document and term) knowledge granularity but ignores the bridging paragraph granularity. However, this two-level granularity may lead to unsatisfactory clustering results with "false correlation". In order to deal with the problem, a Hierarchical Representation Model with Multi-granularity (HRMM), which consists of five-layer representation of data and a two-phase clustering process is proposed based on granular computing and article structure theory. To deal with the zero-valued similarity problem resulted from the sparse term-paragraph matrix, an ontology based strategy and a tolerance-rough-set based strategy are introduced into HRMM. By using granular computing, structural knowledge hidden in documents can be more efficiently and effectively captured in HRMM and thus web document clusters with higher quality can be generated. Extensive experiments show that HRMM, HRMM with tolerance-rough-set strategy, and HRMM with ontology all outperform VSM and a representative non VSM-based algorithm, WFP, significantly in terms of the F-Score.