Evidence Evaluation for Bayesian Neural Networks Using Contour Monte Carlo

Authors:
Faming Liang
Affiliations:
Department of Statistics, Texas A&M University, College Station, TX 77843, U.S.A.
Venue:
Neural Computation
Year:
2005

Citing 8
Cited 1

A practical Bayesian framework for backpropagation networks

Neural Computation
Issues in Bayesian analysis of neural network models

Neural Computation
Bayesian neural networks for classification: how useful is the evidence framework

Neural Networks
Structural learning and rule discovery

Knowledge-based neurocomputing
Bayesian Learning for Neural Networks

Bayesian Learning for Neural Networks
Neural Networks for Pattern Recognition

Neural Networks for Pattern Recognition
Time Series Analysis, Forecasting and Control

Time Series Analysis, Forecasting and Control
A review of Bayesian neural networks with an application to near infrared spectroscopy

IEEE Transactions on Neural Networks

Annealing stochastic approximation Monte Carlo algorithm for neural network training

Machine Learning

Quantified Score

Hi-index	0.00

Visualization

Abstract

Bayesian neural networks play an increasingly important role in modeling and predicting nonlinear phenomena in scientific computing. In this article, we propose to use the contour Monte Carlo algorithm to evaluate evidence for Bayesian neural networks. In the new method, the evidence is dynamically learned for each of the models. Our numerical results show that the new method works well for both the regression and classification multilayer perceptrons. It often leads to an improved estimate, in terms of overall accuracy, for the evidence of multiple MLPs in comparison with the reversible-jump Markov chain Monte Carlo method and the gaussian approximation method. For the simulated data, it can identify the true models, and for the real data, it can produce results consistent with those published in the literature.