Scalable dynamic self-organising maps for mining massive textual data

  • Authors:
  • Yu Zheng Zhai;Arthur Hsu;Saman K. Halgamuge

  • Affiliations:
  • Department of Mechanical and Manufacturing Engineering, University of Melbourne, Victoria, Australia;Department of Mechanical and Manufacturing Engineering, University of Melbourne, Victoria, Australia;Department of Mechanical and Manufacturing Engineering, University of Melbourne, Victoria, Australia

  • Venue:
  • ICONIP'06 Proceedings of the 13th international conference on Neural information processing - Volume Part III
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Traditional text clustering methods require enormous computing resources, which make them inappropriate for processing large scale data collections. In this paper we present a clustering method based on the word category map approach using a two-level Growing Self-Organising Map (GSOM). A significant part of the clustering task is divided into separate subtasks that can be executed on different computers using the emergent Grid technology. Thus enabling the rapid analysis of information gathered globally. The performance of the proposed method is comparable to the traditional approaches while improves the execution time by 15 times.