A Taxonomy of Global Optimization Methods Based on Response Surfaces

Authors:
Donald R. Jones
Affiliations:
General Motors Corporation, Mail Code 480-305-200, 6440 East 12 Mile Road, Warren, MI 48090, USA (e-mail: don.jones@gm.com)
Venue:
Journal of Global Optimization
Year:
2001

Citing 4
Cited 76

Global optimization

Global optimization
Bayesian Algorithms for One-Dimensional GlobalOptimization

Journal of Global Optimization
Efficient Global Optimization of Expensive Black-Box Functions

Journal of Global Optimization
A Radial Basis Function Method for Global Optimization

Journal of Global Optimization

A Pseudo-Global Optimization Approach with Application to the Design of Containerships

Journal of Global Optimization
TRIOPT: a triangulation-based partitioning algorithm for global optimization

Journal of Computational and Applied Mathematics
Constrained Global Optimization of Expensive Black Box Functions Using Radial Basis Functions

Journal of Global Optimization
On the Design of Optimization Strategies Based on Global Response Surface Approximation Models

Journal of Global Optimization
A Combined Global & Local Search (CGLS) Approach to Global Optimization

Journal of Global Optimization
Optimizing thermal design of data center cabinets with a new multi-objective genetic algorithm

Distributed and Parallel Databases
SNOBFIT -- Stable Noisy Optimization by Branch and Fit

ACM Transactions on Mathematical Software (TOMS)
An adaptive radial basis algorithm (ARBF) for expensive black-box global optimization

Journal of Global Optimization
Active Learning for High Throughput Screening

DS '08 Proceedings of the 11th International Conference on Discovery Science
Using Gaussian Processes to Optimize Expensive Functions

AI '08 Proceedings of the 21st Australasian Joint Conference on Artificial Intelligence: Advances in Artificial Intelligence
Improved scatter search for the global optimization of computationally expensive dynamic models

Journal of Global Optimization
Global optimization of expensive-to-evaluate functions: an empirical comparison of two sampling criteria

Journal of Global Optimization
A kriging based method for the solution of mixed-integer nonlinear programs containing black-box functions

Journal of Global Optimization
Kriging metamodel management in the design optimization of a CNG injection system

Mathematics and Computers in Simulation
A gaussian random field model of smooth fitness landscapes

Proceedings of the tenth ACM SIGEVO workshop on Foundations of genetic algorithms
A Response Surface Approach to Beam Orientation Optimization in Intensity-Modulated Radiation Therapy Treatment Planning

INFORMS Journal on Computing
An informational approach to the global optimization of expensive-to-evaluate functions

Journal of Global Optimization
A hybrid multiagent approach for global trajectory optimization

Journal of Global Optimization
A review of recent advances in global optimization

Journal of Global Optimization
Fuzzy clustering based Gaussian process model for large training set and its application in expensive evolutionary optimization

CEC'09 Proceedings of the Eleventh conference on Congress on Evolutionary Computation
TRIOPT: a triangulation-based partitioning algorithm for global optimization

Journal of Computational and Applied Mathematics
Closed-loop evolutionary multiobjective optimization

IEEE Computational Intelligence Magazine
Search for Kriging approximation in cement paste performance

CIMMACS'09 Proceedings of the 8th WSEAS International Conference on Computational intelligence, man-machine systems and cybernetics
On the performance of metamodel assisted MOEA/D

ISICA'07 Proceedings of the 2nd international conference on Advances in computation and intelligence
Bayesian optimization for sensor set selection

Proceedings of the 9th ACM/IEEE International Conference on Information Processing in Sensor Networks
Expensive multiobjective optimization by MOEA/D with Gaussian process model

IEEE Transactions on Evolutionary Computation
ConBreO: a music performance rendering system using hybrid approach of IEC and automated evolution

Proceedings of the 12th annual conference on Genetic and evolutionary computation
Bayesian Monte Carlo for the Global Optimization of Expensive Functions

Proceedings of the 2010 conference on ECAI 2010: 19th European Conference on Artificial Intelligence
Optimization of forging processes using Finite Element simulations

Structural and Multidisciplinary Optimization
Brain-computer evolutionary multiobjective optimization: a genetic algorithm adapting to the decision maker

IEEE Transactions on Evolutionary Computation - Special issue on preference-based multiobjective evolutionary algorithms
Extracting optimal datasets for metamodelling and perspectives for incremental samplings

Mathematics and Computers in Simulation
Towards inverse modeling of turbidity currents: The inverse lock-exchange problem

Computers & Geosciences
Theory and Use of the EM Algorithm

Foundations and Trends in Signal Processing
Hierarchical stochastic metamodels based on moving least squares and polynomial chaos expansion

Structural and Multidisciplinary Optimization
Evolving optimal agendas for package deal negotiation

Proceedings of the 13th annual conference on Genetic and evolutionary computation
Geometric surrogate-based optimisation for permutation-based problems

Proceedings of the 13th annual conference companion on Genetic and evolutionary computation
Geometric generalisation of surrogate model based optimisation to combinatorial spaces

EvoCOP'11 Proceedings of the 11th European conference on Evolutionary computation in combinatorial optimization
Mixture surrogate models based on Dempster-Shafer theory for global optimization problems

Journal of Global Optimization
Multi-objective reliability-based optimization with stochastic metamodels

Evolutionary Computation
Interpolatory Projection Methods for Parameterized Model Reduction

SIAM Journal on Scientific Computing
A framework for optimization under limited information

Proceedings of the 5th International ICST Conference on Performance Evaluation Methodologies and Tools
Robust gaussian process-based global optimization using a fully bayesian expected improvement criterion

LION'05 Proceedings of the 5th international conference on Learning and Intelligent Optimization
Towards an intelligent non-stationary performance prediction of engineering systems

LION'05 Proceedings of the 5th international conference on Learning and Intelligent Optimization
Numerical assessment of metamodelling strategies in computationally intensive optimization

Environmental Modelling & Software
A Kriging-based algorithm to optimize production systems approximated by analytical models

Journal of Intelligent Manufacturing
Surrogate modeling in the evolutionary optimization of catalytic materials

Proceedings of the 14th annual conference on Genetic and evolutionary computation
An experimental methodology for response surface optimization methods

Journal of Global Optimization
Constrained multifidelity optimization using model calibration

Structural and Multidisciplinary Optimization
Query strategies for evading convex-inducing classifiers

The Journal of Machine Learning Research
Parallel algorithm configuration

LION'12 Proceedings of the 6th international conference on Learning and Intelligent Optimization
High-dimensional model-based optimization based on noisy evaluations of computer games

LION'12 Proceedings of the 6th international conference on Learning and Intelligent Optimization
Automatic surrogate model type selection during the optimization of expensive black-box problems

Proceedings of the Winter Simulation Conference
A framework for optimization under limited information

Journal of Global Optimization
SO-MI: A surrogate model algorithm for computationally expensive nonlinear mixed-integer black-box global optimization problems

Computers and Operations Research
Setting targets for surrogate-based optimization

Journal of Global Optimization
Worst-case global optimization of black-box functions through Kriging and relaxation

Journal of Global Optimization
Model guided sampling optimization with gaussian processes for expensive black-box optimization

Proceedings of the 15th annual conference companion on Genetic and evolutionary computation
Variable risk control via stochastic optimization

International Journal of Robotics Research
Examples of inconsistency in optimization by expected improvement

Journal of Global Optimization
A branch and bound algorithm for the global optimization of Hessian Lipschitz continuous functions

Journal of Global Optimization
Exploring or reducing noise?

Structural and Multidisciplinary Optimization
Performance of an ensemble of ordinary, universal, non-stationary and limit Kriging predictors

Structural and Multidisciplinary Optimization
Efficient global optimization algorithm assisted by multiple surrogate techniques

Journal of Global Optimization
Enhancing intill sampling criteria for surrogate-based constrained optimization

Journal of Computational Methods in Sciences and Engineering - Special issue on Advances in Simulation-Driven Optimization and Modeling
A bi-level meta-modeling approach for structural optimization using modified POD bases and Diffuse Approximation

Computers and Structures
Bayesian optimization in high dimensions via random embeddings

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Integrated experimental design and nonlinear optimization to handle computationally expensive models under resource constraints

Journal of Global Optimization
Global optimization of expensive black box problems with a known lower bound

Journal of Global Optimization
A modification of the DIRECT method for Lipschitz global optimization for a symmetric function

Journal of Global Optimization
The use of partially converged simulations in building surrogate models

Advances in Engineering Software
Noisy kriging-based optimization methods: A unified implementation within the DiceOptim package

Computational Statistics & Data Analysis
Utilizing expected improvement and generalized data envelopment analysis in multi-objective genetic algorithms

Journal of Global Optimization
Global search perspectives for multiobjective optimization

Journal of Global Optimization
Cross-validation based single response adaptive design of experiments for Kriging metamodeling of deterministic computer simulations

Structural and Multidisciplinary Optimization
A benchmark of kriging-based infill criteria for noisy optimization

Structural and Multidisciplinary Optimization
Review: Structural design employing a sequential approximation optimization approach

Computers and Structures

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a taxonomy of existing approaches for using response surfaces for global optimization. Each method is illustrated with a simple numerical example that brings out its advantages and disadvantages. The central theme is that methods that seem quite reasonable often have non-obvious failure modes. Understanding these failure modes is essential for the development of practical algorithms that fulfill the intuitive promise of the response surface approach.