Study of genetic algorithms with crossover based on confidence intervals as an alternative to classical least squares estimation methods for nonlinear models

  • Authors:
  • Domingo Ortiz-Boyer;César Harvás-Martínez;José Muñoz-Pérez

  • Affiliations:
  • Department of Computer Science, University of Córdoba, Building 2, Campus of Rabanales s/n, E-14071 Córdoba, Spain;Department of Computer Science, University of Córdoba, Building 2, Campus of Rabanales s/n, E-14071 Córdoba, Spain;Department of Languages and Computer Science, University of Málaga, Technological Complex, Teatinos Campus, E-29071 Málaga, Spain

  • Venue:
  • Metaheuristics
  • Year:
  • 2004

Quantified Score

Hi-index 0.01

Visualization

Abstract

Genetic algorithms are optimization techniques especially useful in functions whose nonlinearity makes an analytical optimization impossible. This kind of functions appear when using least squares estimators in nonlinear regression problems. Least squares optimizers in general, and the Levenberg-Marquardt method in particular, are iterative methods especially designed to solve this kind of problems, but the results depend on both the features of the problem and the closeness to the optimum of the starting point. In this paper we study the least squares estimator and the optimization methods that are based on it. Then we analyze those features of real-coded genetic algorithms that can be useful in the context of nonlinear regression. Special attention will be devoted to the crossover operator, and a new operator based on confidence intervals will be proposed. This crossover provides an equilibrium between exploration and exploitation of the search space, which is very adequate for this kind of problems. To analyze the fitness and robustness of the proposed crossover operator, we will use three complex nonlinear regression problems with search domains of different amplitudes and compare its performance with that of other crossover operators and with the Levenberg-Marquardt method using a multi-start scheme.