Introduction to Stochastic Search and Optimization

Authors:
James C. Spall
Affiliations:
-
Venue:
Introduction to Stochastic Search and Optimization
Year:
2003

Citing 0
Cited 189

Stochastic Approximation and Rate-Distortion Analysis for Robust Structure and Motion Estimation

International Journal of Computer Vision
Face reconstruction from monocular video using uncertainty analysis and a generic model

Computer Vision and Image Understanding - Special issue on Face recognition
Biologically inspired rule-based multiset programming paradigm for soft-computing

Proceedings of the 1st conference on Computing frontiers
An efficient voltage scaling algorithm for complex SoCs with few number of voltage modes

Proceedings of the 2004 international symposium on Low power electronics and design
Issues on simulation and optimization II: targeting aviation delay through simulation optimization

Proceedings of the 35th conference on Winter simulation: driving innovation
Online convex optimization in the bandit setting: gradient descent without a gradient

SODA '05 Proceedings of the sixteenth annual ACM-SIAM symposium on Discrete algorithms
Application of grid-enabled technologies for solving optimization problems in data-driven reservoir studies

Future Generation Computer Systems
Modeling and performance study of restoration framework in WDM optical networks

Computer Networks: The International Journal of Computer and Telecommunications Networking
An Autonomic Reservoir Framework for the Stochastic Optimization of Well Placement

Cluster Computing
Constrained Ordinal Optimization--A Feasibility Model Based Approach

Discrete Event Dynamic Systems
Universal parameter optimisation in games based on SPSA

Machine Learning
Multiple task assignments for cooperating uninhabited aerial vehicles using genetic algorithms

Computers and Operations Research
Stochastic approximation with simulated annealing as an approach to global discrete-event simulation optimization

WSC '04 Proceedings of the 36th conference on Winter simulation
Adaptive control variates

WSC '04 Proceedings of the 36th conference on Winter simulation
Combined pattern search and ranking and selection for simulation optimization

WSC '04 Proceedings of the 36th conference on Winter simulation
Simulation optimization: a review, new developments, and applications

WSC '05 Proceedings of the 37th conference on Winter simulation
Adaptive stepsizes for recursive estimation with applications in approximate dynamic programming

Machine Learning
On the construction and analysis of stochastic models: characterization and propagation of the errors associated with limited data

Journal of Computational Physics - Special issue: Uncertainty quantification in simulation science
Adaptation of the UOBYQA algorithm for noisy functions

Proceedings of the 38th conference on Winter simulation
State-of-the-Art Review: A User's Guide to the Brave New World of Designing Simulation Experiments

INFORMS Journal on Computing
Developing and Assembling the Law School Admission Test

Interfaces
Simulated Annealing for Convex Optimization

Mathematics of Operations Research
An Adaptive Multimeme Algorithm for Designing HIV Multidrug Therapies

IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Reinforcement learning by reward-weighted regression for operational space control

Proceedings of the 24th international conference on Machine learning
Ultra-fast and efficient algorithm for energy optimization by gradient-based stochastic voltage and task scheduling

ACM Transactions on Design Automation of Electronic Systems (TODAES)
Classification of biomedical high-resolution micro-CT images for direct volume rendering

AIAP'07 Proceedings of the 25th conference on Proceedings of the 25th IASTED International Multi-Conference: artificial intelligence and applications
Adaptive population-based search: Application to estimation of nonlinear regression parameters

Computational Statistics & Data Analysis
Learning to Control in Operational Space

International Journal of Robotics Research
Complex schemes of filtering in experimental data estimation

MCBC'07 Proceedings of the 8th Conference on 8th WSEAS Int. Conference on Mathematics and Computers in Biology and Chemistry - Volume 8
Regression models and experimental designs: a tutorial for simulation analysts

Proceedings of the 39th conference on Winter simulation: 40 years! The best is yet to come
Finite-sample performance guarantees for one-dimensional stochastic root finding

Proceedings of the 39th conference on Winter simulation: 40 years! The best is yet to come
Stochastic trust region gradient-free method (strong): a new response-surface-based algorithm in simulation optimization

Proceedings of the 39th conference on Winter simulation: 40 years! The best is yet to come
Continuation methods for adapting simulated skills

ACM SIGGRAPH 2008 papers
A neural stochastic multiscale optimization framework for sensor-based parameter estimation

Integrated Computer-Aided Engineering
Variable step search algorithm for feedforward networks

Neurocomputing
Tuning continual exploration in reinforcement learning: An optimality property of the Boltzmann strategy

Neurocomputing
Stochastic search methods for nash equilibrium approximation in simulation-based games

Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 2
Solving discrete resource allocation problems using the Simultaneous Perturbation Stochastic Approximation (SPSA) algorithm

SpringSim '07 Proceedings of the 2007 spring simulation multiconference - Volume 3
Generating exact D-optimal designs for polynomial models

SpringSim '07 Proceedings of the 2007 spring simulation multiconference - Volume 3
Adaptive neural queue management for TCP networks

Computers and Electrical Engineering
Functional Test Generation Based on Combined Random and Deterministic Search Methods

Informatica
Dynamic Data-Driven Systems Approach for Simulation Based Optimizations

ICCS '07 Proceedings of the 7th international conference on Computational Science, Part I: ICCS 2007
Design of experiments on neural network's training for nonlinear time series forecasting

Neurocomputing
Global optimization of higher order moments in portfolio selection

Journal of Global Optimization
Retrospective-approximation algorithms for the multidimensional stochastic root-finding problem

ACM Transactions on Modeling and Computer Simulation (TOMACS)
Stochastic Subset Optimization for reliability optimization and sensitivity analysis in system design

Computers and Structures
An ordinal optimization theory-based algorithm for a class of simulation optimization problems and application

Expert Systems with Applications: An International Journal
Discrete stochastic optimization using linear interpolation

Proceedings of the 40th Conference on Winter Simulation
QL2, a simple reinforcement learning scheme for two-player zero-sum Markov games

Neurocomputing
An Entropy-Based Approach to the Hierarchical Acquisition of Perception-Action Capabilities

Cognitive Vision
Online Feature Selection Algorithm with Bayesian l 1 Regularization

PAKDD '09 Proceedings of the 13th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining
Cross-entropy based data association for multi target tracking

Proceedings of the 3rd International Conference on Performance Evaluation Methodologies and Tools
Partially Observed Markov Decision Process Multiarmed Bandits---Structural Results

Mathematics of Operations Research
Hybrid spectral gradient method for the unconstrained minimization problem

Journal of Global Optimization
Large-scale uncertainty management systems: learning and exploiting your data

Proceedings of the 2009 ACM SIGMOD International Conference on Management of data
Testing Significance in Bayesian Classifiers

Proceedings of the 2005 conference on Advances in Logic Based Intelligent Systems: Selected Papers of LAPTEC 2005
Optimal Threshold Policies for Multivariate Stopping-Time POMDPs

ECSQARU '09 Proceedings of the 10th European Conference on Symbolic and Quantitative Approaches to Reasoning with Uncertainty
A linear-complexity reparameterisation strategy for the hierarchical bootstrapping of capabilities within perception-action architectures

Image and Vision Computing
Automating knowledge capture in the aerospace domain

Proceedings of the fifth international conference on Knowledge capture
Heat-ray: combating identity snowball attacks using machinelearning, combinatorial optimization and attack graphs

Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles
Modeling and performance study of restoration framework in WDM optical networks

Computer Networks: The International Journal of Computer and Telecommunications Networking
A method for handling uncertainty in evolutionary optimization with an application to feedback control of combustion

IEEE Transactions on Evolutionary Computation - Special issue on computational finance and economics
Optimal threshold policies for multivariate POMDPs in radar resource management

IEEE Transactions on Signal Processing
Decentralized spectrum access amongstcognitive radios: an interacting multivariate global game-theoretic approach

IEEE Transactions on Signal Processing
Heuristic Kalman algorithm for solving optimization problems

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Adaptive Lp-norm diversity combining in non-Gaussian noise and interference

IEEE Transactions on Wireless Communications
Efficient Monte Carlo computation of Fisher information matrix using prior information

PerMIS '07 Proceedings of the 2007 Workshop on Performance Metrics for Intelligent Systems
Periodic step-size adaptation in second-order gradient descent for single-pass on-line structured learning

Machine Learning
Simulation optimization using the cross-entropy method with optimal computing budget allocation

ACM Transactions on Modeling and Computer Simulation (TOMACS)
Gradient estimation for discrete-event systems by measure-valued differentiation

ACM Transactions on Modeling and Computer Simulation (TOMACS)
Stochastic gradient descent training for L1-regularized log-linear models with cumulative penalty

ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1 - Volume 1
Configuring resource managers using model fuzzing: a case study of the .NET thread pool

IM'09 Proceedings of the 11th IFIP/IEEE international conference on Symposium on Integrated Network Management
Gradient estimation in global optimization algorithms

CEC'09 Proceedings of the Eleventh conference on Congress on Evolutionary Computation
Stopping small-sample stochastic approximation

ACC'09 Proceedings of the 2009 conference on American Control Conference
Probabilistically-robust performance optimization for controlled linear stochastic systems

ACC'09 Proceedings of the 2009 conference on American Control Conference
System reliability estimation and confidence regions from subsystem and full system tests

ACC'09 Proceedings of the 2009 conference on American Control Conference
Stochastic orthogonal and nonorthogonal subspace basis pursuit

IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Application of Grid-enabled technologies for solving optimization problems in data-driven reservoir studies

Future Generation Computer Systems
Applying control theory in the real world: experience with building a controller for the .NET thread pool

ACM SIGMETRICS Performance Evaluation Review
Constructions of equiangular tight frames with genetic algorithms

SMC'09 Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics
An efficient least-squares trilateration algorithm for mobile robot localization

IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems
ParamILS: an automatic algorithm configuration framework

Journal of Artificial Intelligence Research
Feature Article---Merging AI and OR to Solve High-Dimensional Stochastic Optimization Problems Using Approximate Dynamic Programming

INFORMS Journal on Computing
A simulation-optimization approach for integrated sourcing and inventory decisions

Computers and Operations Research
An optimization-based approach to special-events traffic signal timing control

Control and Intelligent Systems
Bidirectional associative memory with learning capability using simultaneous perturbation

Neurocomputing
Reliability estimation and confidence regions from subsystem and full system tests via maximum likelihood

PerMIS '08 Proceedings of the 8th Workshop on Performance Metrics for Intelligent Systems
Optimizing walking controllers for uncertain inputs and environments

ACM SIGGRAPH 2010 papers
New inference strategies for solving Markov decision processes using reversible jump MCMC

UAI '09 Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence
Simulation-based game theoretic analysis of keyword auctions with low-dimensional bidding strategies

UAI '09 Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence
Adaptive Lp-norm metric for secondary BICM-OFDM systems

GLOBECOM'09 Proceedings of the 28th IEEE conference on Global telecommunications
A relaxed half-stochastic iterative decoder for LDPC codes

GLOBECOM'09 Proceedings of the 28th IEEE conference on Global telecommunications
Adaptive coherent Lp-norm combining

ICC'09 Proceedings of the 2009 IEEE international conference on Communications
Monotonicity of constrained optimal transmission policies in correlated fading channels with ARQ

IEEE Transactions on Signal Processing
Memetic compact differential evolution for cartesian robot control

IEEE Computational Intelligence Magazine
Benchmarking SPSA on BBOB-2010 noiseless function testbed

Proceedings of the 12th annual conference companion on Genetic and evolutionary computation
Benchmarking SPSA on BBOB-2010 noisy function testbed

Proceedings of the 12th annual conference companion on Genetic and evolutionary computation
On Choosing Parameters in Retrospective-Approximation Algorithms for Stochastic Root Finding and Simulation Optimization

Operations Research
Robust height estimation of moving objects from uncalibrated videos

IEEE Transactions on Image Processing
Sampling-based path planning on configuration-space costmaps

IEEE Transactions on Robotics
Optimal design of arch dams subjected to earthquake loading by a combination of simultaneous perturbation stochastic approximation and particle swarm algorithms

Applied Soft Computing
A survey on approaches for reliability-based optimization

Structural and Multidisciplinary Optimization
A dynamical games approach to transmission-rate adaptation in multimedia WLAN

IEEE Transactions on Signal Processing
Optimum combination of full system and subsystem tests for estimating the reliability of a system

PerMIS '09 Proceedings of the 9th Workshop on Performance Metrics for Intelligent Systems
Target existence based resource allocation

IEEE Transactions on Signal Processing
Evolutionary algorithms with stable mutations based on a discrete spectral measure

ICAISC'10 Proceedings of the 10th international conference on Artifical intelligence and soft computing: Part II
Transmission control in cognitive radio as a Markovian dynamic game: structural result on randomized threshold policies

IEEE Transactions on Communications
The stochastic root-finding problem: Overview, solutions, and open questions

ACM Transactions on Modeling and Computer Simulation (TOMACS)
A two-view learning approach for image tag ranking

Proceedings of the fourth ACM international conference on Web search and data mining
Continuous-Time Stochastic Averaging on the Infinite Interval for Locally Lipschitz Systems

SIAM Journal on Control and Optimization
Natural actor and belief critic: Reinforcement algorithm for learning parameters of dialogue systems modelled as POMDPs

ACM Transactions on Speech and Language Processing (TSLP)
A closed-form algorithm for the least-squares trilateration problem

Robotica
Experimental identification of an uncertain computational dynamical model representing a family of structures

Computers and Structures
Survey paper: Research on probabilistic methods for control system design

Automatica (Journal of IFAC)
Simulation model calibration with correlated knowledge-gradients

Winter Simulation Conference
Predicting web searcher satisfaction with existing community-based answers

Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval
Large scale real-life action recognition using conditional random fields with stochastic training

PAKDD'11 Proceedings of the 15th Pacific-Asia conference on Advances in knowledge discovery and data mining - Volume Part II
OSiMa: human pose estimation from a single image

PReMI'11 Proceedings of the 4th international conference on Pattern recognition and machine intelligence
Reinforcement learning through global stochastic search in N-MDPs

ECML PKDD'11 Proceedings of the 2011 European conference on Machine learning and knowledge discovery in databases - Volume Part II
Pattern discrete and mixed Hit-and-Run for global optimization

Journal of Global Optimization
Seat inventory control for sequential multiple flights with customer choice behavior

Computers and Industrial Engineering
Brief paper: Optimal distributed linear averaging

Automatica (Journal of IFAC)
Stochastic subset optimization incorporating moving least squares response surface methodologies for stochastic sampling

Advances in Engineering Software
Model-driven engineering of planning and optimisation algorithms for pervasive computing environments

Pervasive and Mobile Computing
Market self-organization under limited information

CAEPIA'11 Proceedings of the 14th international conference on Advances in artificial intelligence: spanish association for artificial intelligence
Programming by optimization

Communications of the ACM
Hierarchical Knowledge Gradient for Sequential Sampling

The Journal of Machine Learning Research
Logarithmic regret algorithms for online convex optimization

COLT'06 Proceedings of the 19th annual conference on Learning Theory
Performance analysis of the simultaneous perturbation stochastic approximation algorithm on the noisy sphere model

Theoretical Computer Science
Optimal tuning of continual online exploration in reinforcement learning

ICANN'06 Proceedings of the 16th international conference on Artificial Neural Networks - Volume Part I
An online AUC formulation for binary classification

Pattern Recognition
Towards dynamic data-driven optimization of oil well placement

ICCS'05 Proceedings of the 5th international conference on Computational Science - Volume Part II
Free energy computations by minimization of Kullback-Leibler divergence: An efficient adaptive biasing potential method for sparse representations

Journal of Computational Physics
Flocking based sensor deployment in mobile sensor networks

Computer Communications
A conditional gaussian martingale algorithm for global optimization

ICCSA'06 Proceedings of the 2006 international conference on Computational Science and Its Applications - Volume Part III
A neural stochastic optimization framework for oil parameter estimation

IDEAL'06 Proceedings of the 7th international conference on Intelligent Data Engineering and Automated Learning
Online Learning and Online Convex Optimization

Foundations and Trends® in Machine Learning
Software environment for parallel optimization of complex systems

PARA'10 Proceedings of the 10th international conference on Applied Parallel and Scientific Computing - Volume Part I
Constrained automated mechanism design for infinite games of incomplete information

Autonomous Agents and Multi-Agent Systems
Cross-entropy motion planning

International Journal of Robotics Research
Nonlinear robust performance analysis using complex-step gradient approximation

Automatica (Journal of IFAC)
Parcae: a system for flexible parallel execution

Proceedings of the 33rd ACM SIGPLAN conference on Programming Language Design and Implementation
A multi dynamics algorithm for global optimization

Mathematical and Computer Modelling: An International Journal
Adaptive search with stochastic acceptance probabilities for global optimization

Operations Research Letters
Convergence properties of the cross-entropy method for discrete optimization

Operations Research Letters
Large-scale learning of word relatedness with constraints

Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining
Designing Optimal Spectral Filters for Inverse Problems

SIAM Journal on Scientific Computing
Approximate stochastic annealing for online control of infinite horizon Markov decision processes

Automatica (Journal of IFAC)
Efficient gradient estimation using finite differencing and likelihood ratios for kinetic Monte Carlo simulations

Journal of Computational Physics
Implementation and application of maximum likelihood reliability estimation from subsystem and full system tests

Proceedings of the 10th Performance Metrics for Intelligent Systems Workshop
Implicitly intersecting weighted automata using dual decomposition

NAACL HLT '12 Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Simulation-based optimal Bayesian experimental design for nonlinear systems

Journal of Computational Physics
Spatial interaction models with individual-level data for explaining labor flows and developing local labor markets

Computational Statistics & Data Analysis
Global optimization using a multipoint type quasi-chaotic optimization method

Applied Soft Computing
Sequential Monte Carlo simulated annealing

Journal of Global Optimization
Optimization via gradient oriented polar random search

Proceedings of the Winter Simulation Conference
Averaging and derivative estimation within stochastic approximation algorithms

Proceedings of the Winter Simulation Conference
Model-based adaptive spatial sampling for occurrence map construction

Statistics and Computing
Agentizing the social science of crime

Proceedings of the Winter Simulation Conference
An introspective on the retrospective-approximation paradigm

Proceedings of the Winter Simulation Conference
Stochastic policy search for variance-penalized semi-Markov control

Proceedings of the Winter Simulation Conference
Combining strong and screening designs for large-scale simulation optimization

Proceedings of the Winter Simulation Conference
Adaptive probabilistic branch and bound for level set approximation

Proceedings of the Winter Simulation Conference
Discrete optimization via approximate annealing adaptive search with stochastic averaging

Proceedings of the Winter Simulation Conference
An approximate annealing search algorithm to global optimization and its connection to stochastic approximation

Proceedings of the Winter Simulation Conference
Root finding via darts: dynamic adaptive random target shooting

Proceedings of the Winter Simulation Conference
Line search methods with variable sample size for unconstrained optimization

Journal of Computational and Applied Mathematics
Stochastic Trust-Region Response-Surface Method STRONG---A New Response-Surface Framework for Simulation Optimization

INFORMS Journal on Computing
A gradient method for unconstrained optimization in noisy environment

Applied Numerical Mathematics
An iterative stochastic ensemble method for parameter estimation of subsurface flow models

Journal of Computational Physics
Constrained stochastic gradient descent for large-scale least squares problem

Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining
Integer-Ordered Simulation Optimization using R-SPLINE: Retrospective Search with Piecewise-Linear Interpolation and Neighborhood Enumeration

ACM Transactions on Modeling and Computer Simulation (TOMACS)
Ranking forests

The Journal of Machine Learning Research
Stochastic variational inference

The Journal of Machine Learning Research
A branch and bound algorithm for the global optimization of Hessian Lipschitz continuous functions

Journal of Global Optimization
On sample size control in sample average approximations for solving smooth stochastic programs

Computational Optimization and Applications
Computational strategy for the crash design analysis using an uncertain computational mechanical model

Computational Mechanics
Optimal Sampling Laws for Stochastically Constrained Simulation Optimization on Finite Sets

INFORMS Journal on Computing
A vision for a stochastic reasoner for autonomic cloud deployment

Proceedings of the Second Nordic Symposium on Cloud Computing & Internet Technologies
Bayesian posteriors of uncertainty quantification in computational structural dynamics for low-and medium-frequency ranges

Computers and Structures
Non-parametric stochastic subset optimization for optimal-reliability design problems

Computers and Structures
Global optimization using the asymptotically independent Markov sampling method

Computers and Structures
Reinforcement learning in robotics: A survey

International Journal of Robotics Research
Lazy paired hyper-parameter tuning

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Low-rank separated representation surrogates of high-dimensional stochastic functions: Application in Bayesian inference

Journal of Computational Physics
Decomposition and dictionary learning for 3D trajectories

Signal Processing
An adaptive zero-variance importance sampling approximation for static network dependability evaluation

Computers and Operations Research
Optimal learning for sequential sampling with non-parametric beliefs

Journal of Global Optimization
Hybridization between multi-objective genetic algorithm and support vector machine for feature selection in walker-assisted gait

Computer Methods and Programs in Biomedicine

Quantified Score

Hi-index	0.09

Visualization

Abstract

From the Publisher:* Unique in its survey of the range of topics. * Contains a strong, interdisciplinary format that will appeal to both students and researchers. * Features exercises and web links to software and data sets.