Using discriminant analysis for multi-class classification: an experimental investigation

Authors:
Tao Li;Shenghuo Zhu;Mitsunori Ogihara
Affiliations:
School of Computer Science, Florida International University, 33199, Miami, FL, USA;NEC Laboratories America, Inc., 33199, Cupertino, CA, USA;Department of Computer Science, University of Rochester, 33199, Rochester, NY, USA
Venue:
Knowledge and Information Systems
Year:
2006

Citing 0
Cited 5

Instance weighting versus threshold adjusting for cost-sensitive classification

Knowledge and Information Systems
Combining structure and function-based descriptors for component retrieval in software digital libraries

Integrated Computer-Aided Engineering
Ranking with decision tree

Knowledge and Information Systems
PSOLDA: A particle swarm optimization approach for enhancing classification accuracy rate of linear discriminant analysis

Applied Soft Computing
Sparse multinomial kernel discriminant analysis (sMKDA)

Pattern Recognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

Many supervised machine learning tasks can be cast as multi-class classification problems. Support vector machines (SVMs) excel at binary classification problems, but the elegant theory behind large-margin hyperplane cannot be easily extended to their multi-class counterparts. On the other hand, it was shown that the decision hyperplanes for binary classification obtained by SVMs are equivalent to the solutions obtained by Fisher's linear discriminant on the set of support vectors. Discriminant analysis approaches are well known to learn discriminative feature transformations in the statistical pattern recognition literature and can be easily extend to multi-class cases. The use of discriminant analysis, however, has not been fully experimented in the data mining literature. In this paper, we explore the use of discriminant analysis for multi-class classification problems. We evaluate the performance of discriminant analysis on a large collection of benchmark datasets and investigate its usage in text categorization. Our experiments suggest that discriminant analysis provides a fast, efficient yet accurate alternative for general multi-class classification problems.