Maximum of Marginal Likelihood Criterion instead of Cross-Validation for Designing of Artificial Neural Networks

Authors:
Zenon Waszczyszyn;Marek Słoński
Affiliations:
Rzeszów University of Technology, Rzeszów, Poland;Cracow University of Technology, Kraków, Poland
Venue:
ICAISC '08 Proceedings of the 9th international conference on Artificial Intelligence and Soft Computing
Year:
2006

Citing 4
Cited 2

NETLAB: algorithms for pattern recognition

NETLAB: algorithms for pattern recognition
Neural Networks: A Comprehensive Foundation

Neural Networks: A Comprehensive Foundation
Neural Networks for Pattern Recognition

Neural Networks for Pattern Recognition
Pattern Recognition and Machine Learning (Information Science and Statistics)

Pattern Recognition and Machine Learning (Information Science and Statistics)

Application of semi-Bayesian neural networks in the identification of load causing beam yielding

ICANN'10 Proceedings of the 20th international conference on Artificial neural networks: Part I
Modal analysis and modified cascade neural networks in identification of geometrical parameters of circular arches

Computers and Structures

Quantified Score

Hi-index	0.00

Visualization

Abstract

The cross-validation method is commonly applied in the design of Artificial Neural Networks (ANNs). In the paper the design of ANN is related to searching for an optimal value of the regularization coefficient or the number of neurons in the hidden layer of network. Instead of the cross-validation procedure, the Maximum of Marginal Likelihood (MML) criterion, taken from Bayesian approach, can be used. The MML criterion, applied to searching for the optimal values of design parameters of neural networks, is illustrated on two examples. The obtained results enable us to formulate conclusions that the MML criterion can be used instead of the cross-validation method (especially for small data sets), since it permits the design of ANNs without formulation of a validation set of patterns.