Rough set based hybrid algorithm for text classification

Authors:
Duoqian Miao;Qiguo Duan;Hongyun Zhang;Na Jiao
Affiliations:
Department of Computer Science and Technology, Tongji University, Caoan Street 4800, Shanghai 201804, China;Department of Computer Science and Technology, Tongji University, Caoan Street 4800, Shanghai 201804, China;Department of Computer Science and Technology, Tongji University, Caoan Street 4800, Shanghai 201804, China;Department of Computer Science and Technology, Tongji University, Caoan Street 4800, Shanghai 201804, China
Venue:
Expert Systems with Applications: An International Journal
Year:
2009

Citing 12
Cited 3

Using a generalized instance set for automatic text categorization

Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
A re-examination of text categorization methods

Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval
Machine learning in automated text categorization

ACM Computing Surveys (CSUR)
Induction of Decision Trees

Machine Learning
Naive (Bayes) at Forty: The Independence Assumption in Information Retrieval

ECML '98 Proceedings of the 10th European Conference on Machine Learning
Text Categorization with Suport Vector Machines: Learning with Many Relevant Features

ECML '98 Proceedings of the 10th European Conference on Machine Learning
A Comparative Study on Feature Selection in Text Categorization

ICML '97 Proceedings of the Fourteenth International Conference on Machine Learning
A Probabilistic Analysis of the Rocchio Algorithm with TFIDF for Text Categorization

ICML '97 Proceedings of the Fourteenth International Conference on Machine Learning
Ensemble Methods in Machine Learning

MCS '00 Proceedings of the First International Workshop on Multiple Classifier Systems
Large margin DragPushing strategy for centroid text categorization

Expert Systems with Applications: An International Journal
Improved Classification for Problem Involving Overlapping Patterns

IEICE - Transactions on Information and Systems
Nearest neighbor pattern classification

IEEE Transactions on Information Theory

Analyzing academic achievement of junior high school students by an improved rough set model

Computers & Education
Two-level hierarchical combination method for text classification

Expert Systems with Applications: An International Journal
Textual data mining for industrial knowledge management and text classification: A business oriented approach

Expert Systems with Applications: An International Journal

Quantified Score

Hi-index	12.05

Visualization

Abstract

Automatic classification of text documents, one of essential techniques for Web mining, has always been a hot topic due to the explosive growth of digital documents available on-line. In text classification community, k-nearest neighbor (kNN) is a simple and yet effective classifier. However, as being a lazy learning method without premodelling, kNN has a high cost to classify new documents when training set is large. Rocchio algorithm is another well-known and widely used technique for text classification. One drawback of the Rocchio classifier is that it restricts the hypothesis space to the set of linear separable hyperplane regions. When the data does not fit its underlying assumption well, Rocchio classifier suffers. In this paper, a hybrid algorithm based on variable precision rough set is proposed to combine the strength of both kNN and Rocchio techniques and overcome their weaknesses. An experimental evaluation of different methods is carried out on two common text corpora, i.e., the Reuters-21578 collection and the 20-newsgroup collection. The experimental results indicate that the novel algorithm achieves significant performance improvement.