An efficient MDS algorithm for the analysis of massive document collections

  • Authors:
  • Yoshitatsu Matsuda;Kazunori Yamaguchi

  • Affiliations:
  • Kazunori Yamaguchi Laboratory, Department of General Systems Studies, Graduate School of Arts and Sciences, The University of Tokyo, Tokyo, Japan;Kazunori Yamaguchi Laboratory, Department of General Systems Studies, Graduate School of Arts and Sciences, The University of Tokyo, Tokyo, Japan

  • Venue:
  • KES'05 Proceedings of the 9th international conference on Knowledge-Based Intelligent Information and Engineering Systems - Volume Part II
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

In order to solve multidimensional scaling (MDS) efficiently, we proposed an algorithm, which apply stochastic gradient algorithm to minimizing well-known MDS criteria [1]. In this paper, the efficient MDS algorithm is applied to the text mining and compared with the SOM [2]. The results verified the validity of our algorithm in the analysis of a massive document collection. Our algorithm could find out some interesting structures from about 100000 articles in Usenet (NetNews).