Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations
Semi-naive Bayesian classifier
EWSL-91 Proceedings of the European working session on learning on Machine learning
The nature of statistical learning theory
The nature of statistical learning theory
An introduction to Kolmogorov complexity and its applications (2nd ed.)
An introduction to Kolmogorov complexity and its applications (2nd ed.)
Combining labeled and unlabeled data with co-training
COLT' 98 Proceedings of the eleventh annual conference on Computational learning theory
Text Classification from Labeled and Unlabeled Documents using EM
Machine Learning - Special issue on information retrieval
Arbitrating among competing classifiers using learned referees
Knowledge and Information Systems
Overcoming the Myopia of Inductive Learning Algorithms with RELIEFF
Applied Intelligence
Machine-Learning Applications of Algorithmic Randomness
ICML '99 Proceedings of the Sixteenth International Conference on Machine Learning
Characterizing Model Erros and Differences
ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
An Evaluation of Grading Classifiers
IDA '01 Proceedings of the 4th International Conference on Advances in Intelligent Data Analysis
Making Reliable Diagnoses with Machine Learning: A Case Study
AIME '01 Proceedings of the 8th Conference on AI in Medicine in Europe: Artificial Intelligence Medicine
Transduction with confidence and credibility
IJCAI'99 Proceedings of the 16th international joint conference on Artificial intelligence - Volume 2
UAI'98 Proceedings of the Fourteenth conference on Uncertainty in artificial intelligence
Transductive machine learning for reliable medical diagnostics
Journal of Medical Systems - Special issue: Computer-based medical systems
Open Set Face Recognition Using Transduction
IEEE Transactions on Pattern Analysis and Machine Intelligence
Quality assessment of individual classifications in machine learning and data mining
Knowledge and Information Systems
Credible Case-Based Inference Using Similarity Profiles
IEEE Transactions on Knowledge and Data Engineering
Learning valued preference structures for solving classification problems
Fuzzy Sets and Systems
Transductive Learning from Relational Data
MLDM '07 Proceedings of the 5th international conference on Machine Learning and Data Mining in Pattern Recognition
Empirical Analysis of Reliability Estimates for Individual Regression Predictions
DaWaK '08 Proceedings of the 10th international conference on Data Warehousing and Knowledge Discovery
Estimation of individual prediction reliability using the local sensitivity analysis
Applied Intelligence
Comparison of approaches for estimating reliability of individual regression predictions
Data & Knowledge Engineering
A relational approach to probabilistic classification in a transductive setting
Engineering Applications of Artificial Intelligence
An overview of advances in reliability estimation of individual predictions in machine learning
Intelligent Data Analysis
FR3: a fuzzy rule learner for inducing reliable classifiers
IEEE Transactions on Fuzzy Systems
Transductive reliability estimation for kernel based classifiers
IDA'07 Proceedings of the 7th international conference on Intelligent data analysis
The Knowledge Engineering Review
Describing the Result of a Classifier to the End-User: Geometric-based Sensitivity
Proceedings of the 2010 conference on ECAI 2010: 19th European Conference on Artificial Intelligence
Transductive learning from textual data with relevant example selection
DEXA'10 Proceedings of the 21st international conference on Database and expert systems applications: Part II
Evaluating reliability of single classifications of neural networks
ICANNGA'11 Proceedings of the 10th international conference on Adaptive and natural computing algorithms - Volume Part I
Using boolean differences for discovering ill-defined attributes in propositional machine learning
MICAI'05 Proceedings of the 4th Mexican international conference on Advances in Artificial Intelligence
Confidence-Based color modeling for online video segmentation
ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part II
Transductive reliability estimation for medical diagnosis
Artificial Intelligence in Medicine
Transductive relational classification in the co-training paradigm
MLDM'12 Proceedings of the 8th international conference on Machine Learning and Data Mining in Pattern Recognition
| Hi-index | 0.00 |
In the past decades Machine Learning algorithms have been successfully used in numerous classification problems. While they usually significantly outperform domain experts (in terms of classification accuracy or otherwise), they are mostly not being used in practice. A plausible reason for this is that it is difficult to obtain an unbiased estimation of a single classification's reliability. In the paper we propose a general transductive method for estimation of classification's reliability on single examples that is independent of the applied Machine Learning algorithm. We compare our method with existing approaches and discuss its advantages. We perform extensive testing on 14 domains and 6 Machine Learning algorithms and show that our approach can frequently yield more than 100% improvement in reliability estimation performance.