Research on multi-dimensional association rules mining in distributed environments based on advanced SQL query

  • Authors:
  • Lei Zhang;Mei Qiao;Degan Zhang

  • Affiliations:
  • Tianjin Key Lab of Intelligent Computing & Novel Software Technology, Tianjin University of Technology, Tianjin, China and Key Laboratory of Computer Vision and System, Ministry of Education, ...;Tianjin Key Lab of Intelligent Computing & Novel Software Technology, Tianjin University of Technology, Tianjin, China and Key Laboratory of Computer Vision and System, Ministry of Education, ...;Tianjin Key Lab of Intelligent Computing & Novel Software Technology, Tianjin University of Technology, Tianjin, China and Key Laboratory of Computer Vision and System, Ministry of Education, ...

  • Venue:
  • FSKD'09 Proceedings of the 6th international conference on Fuzzy systems and knowledge discovery - Volume 2
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper proposes the MDMA (Multi-dimensional Distributed Mining Association rules) algorithm based on advanced SQL query. The algorithm works on star-style structure networks. It uses CUBE operator in new standard SQL and combines with SQL powerful query function. So there is no need for the proposed algorithm to conduct a great deal of iterations to generate frequent itemsets in the process of mining association rules. Therefore, no matter what the number of the site in the distributed environments and the scale of the local database in the local site is, the algorithm always needs only two times of scanning the database and only three times of network communications to generate all the global frequent itemsets. Consequently, this algorithm has the merits of light network traffic, low time cost, better scalability and more simplicity.