Improving classifier utility by altering the misclassification cost ratio

Authors:
Michelle Ciraco;Michael Rogalewski;Gary Weiss
Affiliations:
Fordham University, Bronx, New York;Fordham University, Bronx, New York;Fordham University, Bronx, New York
Venue:
UBDM '05 Proceedings of the 1st international workshop on Utility-based data mining
Year:
2005

Citing 4
Cited 12

C4.5: programs for machine learning

C4.5: programs for machine learning
MetaCost: a general method for making classifiers cost-sensitive

KDD '99 Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining
The Case against Accuracy Estimation for Comparing Induction Algorithms

ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
The foundations of cost-sensitive learning

IJCAI'01 Proceedings of the 17th international joint conference on Artificial intelligence - Volume 2

Does cost-sensitive learning beat sampling for classifying rare classes?

UBDM '05 Proceedings of the 1st international workshop on Utility-based data mining
Configuring topologies of distributed semantic concept classifiers for continuous multimedia stream processing

MM '08 Proceedings of the 16th ACM international conference on Multimedia
Estimating the utility value of individual credit card delinquents

Expert Systems with Applications: An International Journal
Principal-agent learning

Decision Support Systems
A rules-based approach for configuring chains of classifiers in real-time stream mining systems

EURASIP Journal on Advances in Signal Processing
Learning with cost intervals

Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining
A distributed approach for optimizing cascaded classifier topologies in real-time stream mining systems

IEEE Transactions on Image Processing
Classification cost: An empirical comparison among traditional classifier, Cost-Sensitive Classifier, and MetaCost

Expert Systems with Applications: An International Journal
Multi-stage modeling using fuzzy multi-criteria feature selection to improve survival prediction of ICU septic shock patients

Expert Systems with Applications: An International Journal
Classification model for detecting and managing credit loan fraud based on individual-level utility concept

ACM SIGMIS Database
Classification model for detecting and managing credit loan fraud based on individual-level utility concept

ACM SIGMIS Database
Influence of class distribution on cost-sensitive learning: A case study of bankruptcy analysis

Intelligent Data Analysis

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper examines whether classifier utility can be improved by altering the misclassification cost ratio (the ratio of false positive misclassification costs to false negative misclassification costs) associated with two-class datasets. This is evaluated by varying the cost ratio passed into two cost-sensitive learners and then evaluating the results using the actual (or presumed actual) cost information. Our results indicate that a cost ratio other than the true ratio often maximizes classifier utility. Furthermore, by using a hold out set to identify the "best" cost ratio for learning, we are able to take advantage of this behavior and generate classifiers that outperform the accepted strategy of always using the actual cost information during the learning phase.