Machine Learning for the Detection of Oil Spills in Satellite Radar Images
Machine Learning - Special issue on applications of machine learning and the knowledge discovery process
Overcoming the Myopia of Inductive Learning Algorithms with RELIEFF
Applied Intelligence
Concept Formation in WWTP by Means of Classification Techniques: ACompared Study
Applied Intelligence
Automatic Construction of Decision Trees from Data: A Multi-Disciplinary Survey
Data Mining and Knowledge Discovery
Evaluating Training Data Suitability for Decision Tree Induction
Journal of Medical Systems
A Distance-Based Approach to Entity Reconciliation in Heterogeneous Databases
IEEE Transactions on Knowledge and Data Engineering
Consensus Decision Trees: Using Consensus Hierarchical Clustering for Data Relabelling and Reduction
EMCL '01 Proceedings of the 12th European Conference on Machine Learning
The Evaluation of Predictive Learners: Some Theoretical and Empirical Results
EMCL '01 Proceedings of the 12th European Conference on Machine Learning
AI '02 Proceedings of the 15th Australian Joint Conference on Artificial Intelligence: Advances in Artificial Intelligence
Rule Quality Measures Improve the Accuracy of Rule Induction: An Experimental Approach
ISMIS '00 Proceedings of the 12th International Symposium on Foundations of Intelligent Systems
Unknown Attribute Values Processing by Meta-learner
ISMIS '02 Proceedings of the 13th International Symposium on Foundations of Intelligent Systems
An Evaluation of Grading Classifiers
IDA '01 Proceedings of the 4th International Conference on Advances in Intelligent Data Analysis
IBC: A First-Order Bayesian Classifier
ILP '99 Proceedings of the 9th International Workshop on Inductive Logic Programming
Diagnosis of sport injuries with machine learning: explanation of induced decisions
CBMS '97 Proceedings of the 10th IEEE Symposium on Computer-Based Medical Systems (CBMS '97)
Web browsing using machine learning on text data
Intelligent exploration of the web
Meta-Learner for Unknown Attribute Values Processing: Dealing with Inconsistency of Meta-Databases
Journal of Intelligent Information Systems
Semantic tagging of unknown proper nouns
Natural Language Engineering
The Knowledge Engineering Review
Automatic semantic tagging of unknown proper names
COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 1
Rule quality for multiple-rule classifier: Empirical expertise and theoretical methodology
Intelligent Data Analysis
Estimating the accuracy of learned concepts
IJCAI'93 Proceedings of the 13th international joint conference on Artifical intelligence - Volume 2
MDL-based acquisition of substitutability relationships between discourse connectives
IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
Machine learning in prognosis of the femoral neck fracture recovery
Artificial Intelligence in Medicine
Using XCS to describe continuous-valued problem spaces
IWLCS'03-05 Proceedings of the 2003-2005 international conference on Learning classifier systems
Two information-theoretic tools to assess the performance of multi-class classifiers
Pattern Recognition Letters
"This sentence is wrong." Detecting errors in machine-translated sentences
Machine Translation
Pareto-optimality of oblique decision trees from evolutionary algorithms
Journal of Global Optimization
Kalman filter-based facial emotional expression recognition
ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part I
Post supervised based learning of feature weight values
SETN'06 Proceedings of the 4th Helenic conference on Advances in Artificial Intelligence
Decision rule-based data models using TRS and NetTRS – methods and algorithms
Transactions on Rough Sets XI
A bayesian metric for evaluating machine learning algorithms
AI'04 Proceedings of the 17th Australian joint conference on Advances in Artificial Intelligence
Discrimination-Based criteria for the evaluation of classifiers
FQAS'06 Proceedings of the 7th international conference on Flexible Query Answering Systems
Measuring performance in health care: case-mix adjustment by boosted decision trees
Artificial Intelligence in Medicine
Machine learning for medical diagnosis: history, state of the art and perspective
Artificial Intelligence in Medicine
Flexible Algorithm Selection Framework for Large Scale Metalearning
WI-IAT '12 Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 01
Proceedings of International Conference on Advances in Mobile Computing & Multimedia
Quantifying the reliability of fault classifiers
Information Sciences: an International Journal
| Hi-index | 0.00 |
In the past few years many systems for learning decision rules from examples were developed. As different systems allow different types of answers when classifying new instances, it is difficult to appropriately evaluate the systems' classification power in comparison with other classification systems or in comparison with human experts. Classification accuracy is usually used as a measure of classification performance. This measure is, however, known to have several defects. A fair evaluation criterion should exclude the influence of the class probabilities which may enable a completely uninformed classifier to trivially achieve high classification accuracy. In this paper a method for evaluating the information score of a classifier's answers is proposed. It excludes the influence of prior probabilities, deals with various types of imperfect or probabilistic answers and can be used also for comparing the performance in different domains.