Parallel rough set based knowledge acquisition using MapReduce from big data

Authors:
Junbo Zhang;Tianrui Li;Yi Pan
Affiliations:
Southwest Jiaotong University, Chengdu, China and Georgia State University, Atlanta, GA;Southwest Jiaotong University, Chengdu, China;Georgia State University, Atlanta, GA
Venue:
Proceedings of the 1st International Workshop on Big Data, Streams and Heterogeneous Source Mining: Algorithms, Systems, Programming Models and Applications
Year:
2012

Citing 23
Cited 2

Comparison of rough-set and statistical methods in inductive learning

International Journal of Man-Machine Studies
Rough sets

Communications of the ACM
Automated extraction of medical expert system rules from clinical databases based on rough set theory

Information Sciences: an International Journal
Discovery through rough set theory

Communications of the ACM
Data mining and rough set theory

Communications of the ACM
A Fast Parallel Clustering Algorithm for Large Spatial Databases

Data Mining and Knowledge Discovery
Data Mining: Concepts and Techniques

Data Mining: Concepts and Techniques
MapReduce: simplified data processing on large clusters

OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
Hybrid attribute reduction based on a novel fuzzy-rough model and information granulation

Pattern Recognition
Evaluating MapReduce for Multi-core and Multiprocessor Systems

HPCA '07 Proceedings of the 2007 IEEE 13th International Symposium on High Performance Computer Architecture
MapReduce: simplified data processing on large clusters

Communications of the ACM - 50th anniversary issue: 1958 - 2008
Mars: a MapReduce framework on graphics processors

Proceedings of the 17th international conference on Parallel architectures and compilation techniques
The WEKA data mining software: an update

ACM SIGKDD Explorations Newsletter
Selecting discrete and continuous features based on neighborhood decision error minimization

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
A rough set approach to mining connections from information systems

Proceedings of the 2010 ACM Symposium on Applied Computing
Positive approximation: An accelerator for attribute reduction in rough set theory

Artificial Intelligence
A comparison of join algorithms for log processing in MaPreduce

Proceedings of the 2010 ACM SIGMOD International Conference on Management of data
Design patterns for efficient graph algorithms in MapReduce

Proceedings of the Eighth Workshop on Mining and Learning with Graphs
Twister: a runtime for iterative MapReduce

Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Rapid parallel genome indexing with MapReduce

Proceedings of the second international workshop on MapReduce and its applications
Fast clustering using MapReduce

Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining
Incremental learning optimization on knowledge discovery in dynamic business intelligent systems

Journal of Global Optimization
A parallel method for computing rough set approximations

Information Sciences: an International Journal

Cloud MapReduce for particle filter-based data assimilation for wildfire spread simulation

Proceedings of the High Performance Computing Symposium
A comparison of parallel large-scale knowledge acquisition using rough set theory on different MapReduce runtime systems

International Journal of Approximate Reasoning

Quantified Score

Hi-index	0.00

Visualization

Abstract

Nowadays, with the volume of data growing at an unprecedented rate, big data mining and knowledge discovery have become a new challenge. Rough set theory for knowledge acquisition has been successfully applied in data mining. The recently introduced MapReduce technique has received much attention from both scientific community and industry for its applicability in big data analysis. To mine knowledge from big data, we present parallel rough set based methods for knowledge acquisition using MapReduce in this paper. Comprehensive experimental evaluation on large data sets shows that the proposed parallel methods can effectively process big data.