Training connectionist networks with queries and selective sampling
Advances in neural information processing systems 2
Original Contribution: Stacked generalization
Neural Networks
An introduction to Kolmogorov complexity and its applications
An introduction to Kolmogorov complexity and its applications
Implementing inner drive through competence reflection
Proceedings of the second international conference on From animals to animats 2 : simulation of adaptive behavior: simulation of adaptive behavior
The nature of statistical learning theory
The nature of statistical learning theory
Machine Learning
Combination of Multiple Classifiers Using Local Accuracy Estimates
IEEE Transactions on Pattern Analysis and Machine Intelligence
A decision-theoretic generalization of on-line learning and an application to boosting
Journal of Computer and System Sciences - Special issue: 26th annual ACM symposium on the theory of computing & STOC'94, May 23–25, 1994, and second annual Europe an conference on computational learning theory (EuroCOLT'95), March 13–15, 1995
Algorithmic stability and sanity-check bounds for leave-one-out cross-validation
COLT '97 Proceedings of the tenth annual conference on Computational learning theory
Combining labeled and unlabeled data with co-training
COLT' 98 Proceedings of the eleventh annual conference on Computational learning theory
An introduction to support Vector Machines: and other kernel-based learning methods
An introduction to support Vector Machines: and other kernel-based learning methods
Machine Learning
Fast Parzen Density Estimation Using Clustering-Based Branch and Bound
IEEE Transactions on Pattern Analysis and Machine Intelligence
Reliable Classifications with Machine Learning
ECML '02 Proceedings of the 13th European Conference on Machine Learning
Ridge Regression Confidence Machine
ICML '01 Proceedings of the Eighteenth International Conference on Machine Learning
Enhancing Supervised Learning with Unlabeled Data
ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
Transduction with Confidence and Credibility
IJCAI '99 Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence
Data perturbation for escaping local maxima in learning
Eighteenth national conference on Artificial intelligence
The Journal of Machine Learning Research
Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models
Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models
epsilon-SSVR: A Smooth Support Vector Machine for epsilon-Insensitive Regression
IEEE Transactions on Knowledge and Data Engineering
Constructive Incremental Learning from Only Local Information
Neural Computation
Generalized Additive Models (Texts in Statistical Science)
Generalized Additive Models (Texts in Statistical Science)
Utilizing hierarchical feature domain values for prediction
Data & Knowledge Engineering
Tests and variables selection on regression analysis for massive datasets
Data & Knowledge Engineering
Semisupervised Regression with Cotraining-Style Algorithms
IEEE Transactions on Knowledge and Data Engineering
Detection and prediction of errors in EPCs of the SAP reference model
Data & Knowledge Engineering
Estimation of individual prediction reliability using the local sensitivity analysis
Applied Intelligence
Machine Learning and Data Mining: Introduction to Principles and Algorithms
Machine Learning and Data Mining: Introduction to Principles and Algorithms
UAI'98 Proceedings of the Fourteenth conference on Uncertainty in artificial intelligence
An overview of advances in reliability estimation of individual predictions in machine learning
Intelligent Data Analysis
Transductive learning for spatial regression with co-training
Proceedings of the 2010 ACM Symposium on Applied Computing
The Knowledge Engineering Review
Neural networks as surrogate models for measurements in optimization algorithms
ASMTA'10 Proceedings of the 17th international conference on Analytical and stochastic modeling techniques and applications
Evaluating reliability of single classifications of neural networks
ICANNGA'11 Proceedings of the 10th international conference on Adaptive and natural computing algorithms - Volume Part I
Surrogate modeling in the evolutionary optimization of catalytic materials
Proceedings of the 14th annual conference on Genetic and evolutionary computation
| Hi-index | 0.00 |
The paper compares different approaches to estimate the reliability of individual predictions in regression. We compare the sensitivity-based reliability estimates developed in our previous work with four approaches found in the literature: variance of bagged models, local cross-validation, density estimation, and local modeling. By combining pairs of individual estimates, we compose a combined estimate that performs better than the individual estimates. We tested the estimates by running data from 28 domains through eight regression models: regression trees, linear regression, neural networks, bagging, support vector machines, locally weighted regression, random forests, and generalized additive model. The results demonstrate the potential of a sensitivity-based estimate, as well as the local modeling of prediction error with regression trees. Among the tested approaches, the best average performance was achieved by estimation using the bagging variance approach, which achieved the best performance with neural networks, bagging and locally weighted regression.