Tuning metaheuristics: A data mining based approach for particle swarm optimization

Authors:
Stefan Lessmann;Marco Caserta;Idel Montalvo Arango
Affiliations:
Institute of Information Systems, University of Hamburg, Von-Melle-Park 5, D-20146 Hamburg, Germany;Institute of Information Systems, University of Hamburg, Von-Melle-Park 5, D-20146 Hamburg, Germany;Centro Multidisciplinar de Modelación de Fluidos, Polytechnic University of Valencia, Spain
Venue:
Expert Systems with Applications: An International Journal
Year:
2011

Citing 44
Cited 0

Future paths for integer programming and links to artificial intelligence

Computers and Operations Research - Special issue: Applications of integer programming
The nature of statistical learning theory

The nature of statistical learning theory
A case study in experimental design applied to genetic algorithms with applications to DNA sequence assembly

American Journal of Mathematical and Management Sciences - Modern digital simulation methodology, III
A systematic procedure for setting parameters in simulated annealing algorithms

Computers and Operations Research
An introduction to support Vector Machines: and other kernel-based learning methods

An introduction to support Vector Machines: and other kernel-based learning methods
Genetic Algorithms in Search, Optimization and Machine Learning

Genetic Algorithms in Search, Optimization and Machine Learning
Random Forests

Machine Learning
Evolution strategies –A comprehensive introduction

Natural Computing: an international journal
Efficient GA Based Techniques for Classification

Applied Intelligence
Using Experimental Design to Find Effective Parameter Settings for Heuristics

Journal of Heuristics
Direct Marketing Performance Modeling Using Genetic Algorithms

INFORMS Journal on Computing
Metaheuristics in combinatorial optimization: Overview and conceptual comparison

ACM Computing Surveys (CSUR)
Tree induction vs. logistic regression: a learning-curve analysis

The Journal of Machine Learning Research
Benchmarking Least Squares Support Vector Machine Classifiers

Machine Learning
An empirical study of impact of crossover operators on the performance of non-binary genetic algorithm based neural approaches for classification

Computers and Operations Research
A tutorial on support vector regression

Statistics and Computing
Customer Targeting: A Neural Network Approach Guided by Genetic Algorithms

Management Science
Large Margin Methods for Structured and Interdependent Output Variables

The Journal of Machine Learning Research
Biostatistical Analysis (5th Edition)

Biostatistical Analysis (5th Edition)
Credit scoring with a data mining approach based on support vector machines

Expert Systems with Applications: An International Journal
Churn prediction in subscription services: An application of support vector machines while comparing two parameter-selection techniques

Expert Systems with Applications: An International Journal
Fine-Tuning of Algorithms Using Fractional Experimental Designs and Local Search

Operations Research
A primal-dual perspective of online learning algorithms

Machine Learning
Classifier ensemble selection using hybrid genetic algorithms

Pattern Recognition Letters
Feature selection to diagnose a business crisis by using a real GA-based support vector machine: An empirical study

Expert Systems with Applications: An International Journal
Particle Swarm Optimization applied to the design of water supply systems

Computers & Mathematics with Applications
Maximizing classifier utility when there are data acquisition and modeling costs

Data Mining and Knowledge Discovery
A novel LS-SVMs hyper-parameter selection based on particle swarm optimization

Neurocomputing
A cross entropy-Lagrangean hybrid algorithm for the multi-item capacitated lot-sizing problem with setup times

Computers and Operations Research
Benchmarking Classification Models for Software Defect Prediction: A Proposed Framework and Novel Findings

IEEE Transactions on Software Engineering
Support vector machine with genetic algorithm for forecasting of key-gas ratios in oil-immersed transformer

Expert Systems with Applications: An International Journal
Improving customer attrition prediction by integrating emotions from client/company interaction emails and evaluating multiple classifiers

Expert Systems with Applications: An International Journal
Handling class imbalance in customer churn prediction

Expert Systems with Applications: An International Journal
Particle swarm optimization for ensembling generation for evidential k-nearest-neighbour classifier

Neural Computing and Applications
Feature weighting heuristics for analogy-based effort estimation models

Expert Systems with Applications: An International Journal
Applying enhanced data mining approaches in predicting bank performance: A case of Taiwanese commercial banks

Expert Systems with Applications: An International Journal
Prediction of silicon content in hot metal using support vector regression based on chaos particle swarm optimization

Expert Systems with Applications: An International Journal
Short-term fault prediction based on support vector machines with parameter optimization by evolution strategy

Expert Systems with Applications: An International Journal
Cutting-plane training of structural SVMs

Machine Learning
A study of cross-validation and bootstrap for accuracy estimation and model selection

IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 2
Predicting customer retention and profitability by using random forests and regression forests techniques

Expert Systems with Applications: An International Journal
Evolutionary tuning of multiple SVM parameters

Neurocomputing
Classification With Ant Colony Optimization

IEEE Transactions on Evolutionary Computation
Mathematical models and methods in the water industry

Mathematical and Computer Modelling: An International Journal

Quantified Score

Hi-index	12.05

Visualization

Abstract

The paper is concerned with practices for tuning the parameters of metaheuristics. Settings such as, e.g., the cooling factor in simulated annealing, may greatly affect a metaheuristic's efficiency as well as effectiveness in solving a given decision problem. However, procedures for organizing parameter calibration are scarce and commonly limited to particular metaheuristics. We argue that the parameter selection task can appropriately be addressed by means of a data mining based approach. In particular, a hybrid system is devised, which employs regression models to learn suitable parameter values from past moves of a metaheuristic in an online fashion. In order to identify a suitable regression method and, more generally, to demonstrate the feasibility of the proposed approach, a case study of particle swarm optimization is conducted. Empirical results suggest that characteristics of the decision problem as well as search history data indeed embody information that allows suitable parameter values to be determined, and that this type of information can successfully be extracted by means of nonlinear regression models.