Adaptation in natural and artificial systems
Adaptation in natural and artificial systems
Convergence Properties of the Nelder--Mead Simplex Method in Low Dimensions
SIAM Journal on Optimization
| Hi-index | 0.00 |
Results from our optimization exercise clearly show the advantage of using the random search algorithms when we anticipate the search for the global optimum to be difficult. When the number of parameters in the model is relatively small (nine parameters) Differential Evolution performs better than Genetic Algorithm. However, when the number of parameters in the model is relatively large (fifteen parameters) the reverse case is true. A comparison of the Quasi-Newton and Simplex methods also shows that both the Quasi-Newton algorithm of shazam and the simplex algorithm of fminsearch are sensitive to starting values. However, allowing shazam to set its starting values or using the PRESAMP option to set the starting values produced the best results for shazam. The general conclusion of this paper is that the choice of optimization technique for difficult optimization problems like the one attempted here should be based on problem attributes. When in doubt, multiple techniques should be applied and the estimated results evaluated.