Experimental evaluation of an automatic parameter setting system

  • Authors:
  • R. Pavón;F. Díaz;R. Laza;M. V. Luzón

  • Affiliations:
  • Computer Science, University of Vigo, Campus Universitario As Lagoas s/n, 32004 Ourense, Spain;Computer Science, University of Valladolid, Plaza Santa Eulalia 9-11, 40005 Segovia, Spain;Computer Science, University of Vigo, Campus Universitario As Lagoas s/n, 32004 Ourense, Spain;Computer Science, University of Granada, C/Periodista Daniel Saucedo Aranda s/n, 18071 Granada, Spain

  • Venue:
  • Expert Systems with Applications: An International Journal
  • Year:
  • 2010

Quantified Score

Hi-index 12.05

Visualization

Abstract

Finding the parameter setting that will result in the optimal performance of a given algorithm for solving a problem is a tedious task. This paper briefly describes a system that automatically chooses the best algorithm parameter configuration conditioned by the current problem instance to solve. The system uses bayesian networks (BN) and case-based reasoning (CBR) methodology to find such a configuration. CBR provides a mechanism to acquire knowledge about the specific problem domain. BN provide a tool to model quantitative and qualitative relationships between parameters of interest. However, the aim of this work is to empirically evaluate the system described, using as an example the configuration of a genetic algorithm that solves the root identification problem. In this context, we report on several statistically guided experimental evaluations. The experimental results confirm the validity of the proposed system and its potential effectiveness for configuring algorithms.