Feature weighted minimum distance classifier with multi-class confidence estimation

Authors:
Mamatha Rudrapatna;Arcot Sowmya
Affiliations:
School of Computer Science and Engineering, University of New South Wales, Sydney, NSW, Australia;School of Computer Science and Engineering, University of New South Wales, Sydney, NSW, Australia
Venue:
AI'06 Proceedings of the 19th Australian joint conference on Artificial Intelligence: advances in Artificial Intelligence
Year:
2006

Citing 15
Cited 1

C4.5: programs for machine learning

C4.5: programs for machine learning
Estimating attributes: analysis and extensions of RELIEF

ECML-94 Proceedings of the European conference on machine learning on Machine Learning
A Review and Empirical Evaluation of Feature Weighting Methods for aClass of Lazy Learning Algorithms

Artificial Intelligence Review - Special issue on lazy learning
On the Optimality of the Simple Bayesian Classifier under Zero-One Loss

Machine Learning - Special issue on learning with probabilistic representations
Bayesian Network Classifiers

Machine Learning - Special issue on learning with probabilistic representations
A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems

Machine Learning
Obtaining calibrated probability estimates from decision trees and naive Bayesian classifiers

ICML '01 Proceedings of the Eighteenth International Conference on Machine Learning
The Case against Accuracy Estimation for Comparing Induction Algorithms

ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
Tree Induction for Probability-Based Ranking

Machine Learning
Pattern Classification (2nd Edition)

Pattern Classification (2nd Edition)
Predicting good probabilities with supervised learning

ICML '05 Proceedings of the 22nd international conference on Machine learning
Classification of microarrays to nearest centroids

Bioinformatics
Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)

Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)
The use of the area under the ROC curve in the evaluation of machine learning algorithms

Pattern Recognition
Generating estimates of classification confidence for a case-based spam filter

ICCBR'05 Proceedings of the 6th international conference on Case-Based Reasoning Research and Development

Situated Cognition in the Semantic Web Era

EKAW '08 Proceedings of the 16th international conference on Knowledge Engineering: Practice and Patterns

Quantified Score

Hi-index	0.00

Visualization

Abstract

In many recognition tasks, a simple discrete class label is not sufficient and ranking of the classes is desirable; in others, a numeric score that represents the confidence of class membership for multiple classes is also required. Differential diagnosis in medical domains and terrain classification in surveying are prime examples. The Minimum Distance Classifier is a well-known, simple and efficient scheme for producing multi-class probabilities. However, when features contribute unequally to the classification, noisy and irrelevant features can distort the distance function. We enhance the minimum distance classifier with feature weights leading to the Feature Weighted Minimum Distance classifier. We empirically compare minimum distance classifier and its enhanced feature weighted version with a number of standard classifiers. We also present preliminary results on medical images with acceptable performance and better interpretability.