Hierarchically SVM classification based on support vector clustering method and its application to document categorization

Authors:
Pei-Yi Hao;Jung-Hsien Chiang;Yi-Kun Tu
Affiliations:
Department of Information Management, National Kaohsiung University of Applied Sciences, Kaohsiung, Taiwan, ROC;Department of Computer Science and Information Engineering, National Cheng Kung University, Tainan, Taiwan;Department of Computer Science and Information Engineering, National Cheng Kung University, Tainan, Taiwan
Venue:
Expert Systems with Applications: An International Journal
Year:
2007

Citing 21
Cited 17

A Validity Measure for Fuzzy Clustering

IEEE Transactions on Pattern Analysis and Machine Intelligence
Automated learning of decision rules for text categorization

ACM Transactions on Information Systems (TOIS)
The nature of statistical learning theory

The nature of statistical learning theory
A comparison of classifiers and document representations for the routing problem

SIGIR '95 Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval
Boosting and Rocchio applied to text filtering

Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
A re-examination of text categorization methods

Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval
Support vector domain description

Pattern Recognition Letters - Special issue on pattern recognition in practice VI
Hierarchical classification of Web content

SIGIR '00 Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval
An Evaluation of Statistical Approaches to Text Categorization

Information Retrieval
Machine learning in automated text categorization

ACM Computing Surveys (CSUR)
Exploiting Hierarchy in Text Categorization

Information Retrieval
Text Categorization with Suport Vector Machines: Learning with Many Relevant Features

ECML '98 Proceedings of the 10th European Conference on Machine Learning
Hierarchically Classifying Documents Using Very Few Words

ICML '97 Proceedings of the Fourteenth International Conference on Machine Learning
A Comparative Study on Feature Selection in Text Categorization

ICML '97 Proceedings of the Fourteenth International Conference on Machine Learning
Improving Text Classification by Shrinkage in a Hierarchy of Classes

ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
Hierarchical Text Classification and Evaluation

ICDM '01 Proceedings of the 2001 IEEE International Conference on Data Mining
Support vector clustering

The Journal of Machine Learning Research
One-class svms for document classification

The Journal of Machine Learning Research
Hierarchical document categorization with support vector machines

Proceedings of the thirteenth ACM international conference on Information and knowledge management
Estimating the Support of a High-Dimensional Distribution

Neural Computation
A new kernel-based fuzzy clustering approach: support vector clustering with cell growing

IEEE Transactions on Fuzzy Systems

A document classification and retrieval system for R&D in semiconductor industry - A hybrid approach

Expert Systems with Applications: An International Journal
Semantic analysis of real-world images using support vector machine

Expert Systems with Applications: An International Journal
@Note: A workbench for Biomedical Text Mining

Journal of Biomedical Informatics
A New Fuzzy Hierarchical Classification Based on SVM for Text Categorization

ICIAR '09 Proceedings of the 6th International Conference on Image Analysis and Recognition
CorpWiki: A self-regulating wiki to promote corporate collective intelligence through expert peer matching

Information Sciences: an International Journal
Fuzzy rule classifier: Capability for generalization in wood color recognition

Engineering Applications of Artificial Intelligence
Techniques for finding similarity knowledge in OLAP reports

Expert Systems with Applications: An International Journal
A survey of hierarchical classification across different application domains

Data Mining and Knowledge Discovery
Predicting high-tech equipment fabrication cost with a novel evolutionary SVM inference model

Expert Systems with Applications: An International Journal
Pattern classification and audiovisual content management techniques using hybrid expert systems: A video-assisted bioacoustics application in Abdominal Sounds pattern analysis

Expert Systems with Applications: An International Journal
An improved K-nearest-neighbor algorithm for text categorization

Expert Systems with Applications: An International Journal
Sparse multikernel support vector regression machines trained by active learning

Expert Systems with Applications: An International Journal
Recurrent sparse support vector regression machines trained by active learning in the time-domain

Expert Systems with Applications: An International Journal
Clustering and categorization of Brazilian portuguese legal documents

PROPOR'12 Proceedings of the 10th international conference on Computational Processing of the Portuguese Language
Conceptual modeling of cardinality constraints in social publishing

International Journal of Intelligent Systems
Probability based document clustering and image clustering using content-based image retrieval

Applied Soft Computing
Document clustering method using dimension reduction and support vector clustering to overcome sparseness

Expert Systems with Applications: An International Journal

Quantified Score

Hi-index	12.06

Visualization

Abstract

Automatic categorization of documents into pre-defined topic hierarchies or taxonomies is a crucial step in knowledge and content management. Standard machine learning techniques like support vector machines and related large margin methods have been successfully applied for this task, albeit the fact is that they ignore the inter-class relationships. Unfortunately, in the context of document categorization, we face a large number of classes and a huge number of relevant features needed to distinguish between them. The computational cost of training a classifier for a problem of this size is prohibitive. It has also been observed that obtaining a classifier that discriminates between two groups of classes is much easier than distinguishing simultaneously among all classes. This has prompted substantial research in using hierarchical classifiers to address single multi-class problems. In this paper, we propose a novel hierarchical classification method that generalizes support vector machine learning that is based on the results of support vector clustering method, and are structured in a way that mirrors the class hierarchy. Compared to previous non-hierarchical SVM classifier and famous documents categorization systems, the proposed hierarchical SVM classification has a better improvement in classification accuracy in the standard Reuters corpus.