Optimizing back-propagation networks via a calibrated heuristic algorithm with an orthogonal array

Authors:
Tai-Yue Wang;Chien-Yu Huang
Affiliations:
National Cheng Kung University, Department of Industrial and Information Management, 1 University Road, Tainan 70101, Taiwan;National Cheng Kung University, Department of Industrial and Information Management, 1 University Road, Tainan 70101, Taiwan
Venue:
Expert Systems with Applications: An International Journal
Year:
2008

Citing 7
Cited 4

Introduction to artificial neural systems

Introduction to artificial neural systems
Toward global optimization of neural networks: a comparison of the genetic algorithm and backpropagation

Decision Support Systems
Genetic Algorithms in Search, Optimization and Machine Learning

Genetic Algorithms in Search, Optimization and Machine Learning
A Genetic Algorithm for Multiobjective Robust Design

Applied Intelligence
Neural network as a decision support system in the development of pharmaceutical formulation-focus on solid dispersions

Expert Systems with Applications: An International Journal
A comparison of supervised and unsupervised neural networks in predicting bankruptcy of Korean firms

Expert Systems with Applications: An International Journal
Genetic evolution of the topology and weight distribution of neural networks

IEEE Transactions on Neural Networks

A transaction pattern analysis system based on neural network

Expert Systems with Applications: An International Journal
An efficient hybrid Taguchi-genetic algorithm for protein folding simulation

Expert Systems with Applications: An International Journal
Research on integrating different methods of neural networks with case-based reasoning and rule-based system to infer causes of notebook computer breakdown

Expert Systems with Applications: An International Journal
Performance of derivative free search ANN training algorithm with time series and classification problems

Computational Statistics

Quantified Score

Hi-index	12.06

Visualization

Abstract

Improving the performance of neural networks is of considerable importance. Although previous studies have investigated how to design the optimal neural network, the heuristic algorithms developed to support the optimization process contain flaws. These heuristic algorithms do not perform efficiently and they require prior expert knowledge. This study commences by employing an orthogonal array using the Taguchi method to calibrate the factor levels of a heuristic algorithm and to estimate the percent contribution from various individual factors. Subsequently, the calibrated heuristic algorithm is used to optimize a back-propagation network (BPN). Changing the level of each individual factor systematically and then analyzing the main and interactive effects of the design factors by using the analysis of variance (ANOVA) leads to the optimal heuristic algorithm factor levels with regard to experimental cost. The proposed optimization procedure is demonstrated on the classification problems using the University of California's Department of Information and Computer Science (ICS) server. The results indicate that the quality of the solution from the proposed approach is superior to that from a non-calibrated conventional design.