SVM-Based feature selection of latent semantic features

Authors:
K. Shima;M. Todoriki;A. Suzuki
Affiliations:
Department of Quantum Engineering and Systems Science, University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 1138656, Japan;Department of Quantum Engineering and Systems Science, University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 1138656, Japan;Department of Quantum Engineering and Systems Science, University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 1138656, Japan
Venue:
Pattern Recognition Letters
Year:
2004

Citing 10
Cited 4

The nature of statistical learning theory

The nature of statistical learning theory
Support-Vector Networks

Machine Learning
An explanation of the effectiveness of latent semantic indexing by means of a Bayesian regression model

Information Processing and Management: an International Journal
Projections for efficient document clustering

Proceedings of the 20th annual international ACM SIGIR conference on Research and development in information retrieval
Inductive learning algorithms and representations for text categorization

Proceedings of the seventh international conference on Information and knowledge management
Making large-scale support vector machine learning practical

Advances in kernel methods
Introduction to Modern Information Retrieval

Introduction to Modern Information Retrieval
Gene Selection for Cancer Classification using Support Vector Machines

Machine Learning
Text Categorization with Suport Vector Machines: Learning with Many Relevant Features

ECML '98 Proceedings of the 10th European Conference on Machine Learning
Support vector machines for spam categorization

IEEE Transactions on Neural Networks

An empirical study of required dimensionality for large-scale latent semantic indexing applications

Proceedings of the 17th ACM conference on Information and knowledge management
Recursive Bayesian linear regression for adaptive classification

IEEE Transactions on Signal Processing
Orientation distance-based discriminative feature extraction for multi-class classification

CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
New methods for text categorization based on a new feature selection method and a new similarity measure between documents

IEA/AIE'06 Proceedings of the 19th international conference on Advances in Applied Artificial Intelligence: industrial, Engineering and Other Applications of Applied Intelligent Systems

Quantified Score

Hi-index	0.10

Visualization

Abstract

Latent Semantic Indexing (LSI) is an effective method to extract features that captures underlying latent semantic structure in the word usage across documents, However, subspace selected by this method may not be the most appropriate one to classify documents, since it orders extracted features according to their variances, not the classification power. We propose to apply feature ordering method based on support vector machines in order to select LSI-features that is suited for classification. Experimental results suggest that the method improves classification performance with considerably more compact representation.