Evaluating the process of a genetic algorithm to improve the back-propagation network: A Monte Carlo study

Authors:
Chien-Yu Huang;Long-Hui Chen;Yueh-Li Chen;Fengming M. Chang
Affiliations:
Department of Information Management, Shu-Te University, Kaohsiung, Taiwan;Department of Logistics Management, Shu-Te University, Kaohsiung, Taiwan;Department of Industrial Engineering and Management, Cheng-Shiu University, Kaohsiung, Taiwan;Department of Information Science and Applications, Asia University, Taichung, Taiwan
Venue:
Expert Systems with Applications: An International Journal
Year:
2009

Citing 12
Cited 6

Introduction to artificial neural systems

Introduction to artificial neural systems
Neural networks and logistic regression: Part I

Computational Statistics & Data Analysis
Two strategies to avoid overfitting in feedforward networks

Neural Networks
Toward global optimization of neural networks: a comparison of the genetic algorithm and backpropagation

Decision Support Systems
A simulation study of artificial neural networks for nonlinear time-series forecasting

Computers and Operations Research
Genetic Algorithms in Search, Optimization and Machine Learning

Genetic Algorithms in Search, Optimization and Machine Learning
Applying robust multi-response quality engineering for parameter selection using a novel neural--genetic algorithm

Computers in Industry
Design of structural modular neural networks with genetic algorithm

Advances in Engineering Software
A neural network model based on the multi-stage optimization approach for short-term food price forecasting in China

Expert Systems with Applications: An International Journal
Fuzzy Delphi and back-propagation model for sales forecasting in PCB industry

Expert Systems with Applications: An International Journal
Use of genetic algorithms for neural networks to predict community-acquired pneumonia

Artificial Intelligence in Medicine
Genetic evolution of the topology and weight distribution of neural networks

IEEE Transactions on Neural Networks

Parameter determination and feature selection for back-propagation network by particle swarm optimization

Knowledge and Information Systems
Comparing performances of backpropagation and genetic algorithms in the data classification

Expert Systems with Applications: An International Journal
Short Communication: Identifying the nature of stomach diseases by ultrasonography based on genetic neural network

Expert Systems with Applications: An International Journal
Comparison of evolutionary computation techniques for noise injected neural network training to estimate longitudinal dispersion coefficients in rivers

Expert Systems with Applications: An International Journal
Automatic construction and optimization of knowledge mesh for self-reconfiguration of knowledgeable manufacturing system

Expert Systems with Applications: An International Journal
Comparing large number of metaheuristics for artificial neural networks training to predict water temperature in a natural river

Computers & Geosciences

Quantified Score

Hi-index	12.06

Visualization

Abstract

Many studies have mapped a bit-string genotype using a genetic algorithm to represent network architectures to improve performance of back-propagation networks (BPN). But the limitations of gradient search techniques applied to complex nonlinear optimization problems have often resulted in inconsistent and unpredictable performance. This study focuses on how to collect and re-evaluate the weight matrices of a BPN while the genetic algorithm operations are processing in each generation to optimize the weight matrices. In this way, overfitting, a drawback of BPNs that usually occurs during the later stage of neural network training with descending training error and ascending prediction error, can also be avoided. This study extends the parameters and topology of the neural network to enhance the feasibility of the solution space for complex nonlinear problems. The value of the proposed model is compared with previous studies using a Monte Carlo study on in-sample, interpolation, and extrapolation data for six test functions.