Using Genetic Algorithms for Parameter Optimization in Building Predictive Data Mining Models

Authors:
Ashish Sureka;Kishore Varma Indukuri
Affiliations:
SETLabs, Infosys Technologies Ltd., Bangalore, India;SETLabs, Infosys Technologies Ltd., Bangalore, India
Venue:
ADMA '08 Proceedings of the 4th international conference on Advanced Data Mining and Applications
Year:
2008

Citing 9
Cited 0

C4.5: programs for machine learning

C4.5: programs for machine learning
Approximate statistical tests for comparing supervised classification learning algorithms

Neural Computation
Principles of data mining

Principles of data mining
An Introduction to Genetic Algorithms

An Introduction to Genetic Algorithms
Genetic Algorithms in Search, Optimization and Machine Learning

Genetic Algorithms in Search, Optimization and Machine Learning
Induction of Decision Trees

Machine Learning
Practical Genetic Algorithms with CD-ROM

Practical Genetic Algorithms with CD-ROM
Problem-Solving Methods in Artificial Intelligence

Problem-Solving Methods in Artificial Intelligence
Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)

Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present an application of genetic algorithms to search the space of model building parameters for optimizing the score function or accuracy of a predictive data mining model. The goal of predictive modeling is to build a classification or regression model that can accurately predict the value of a target column by observing the values of the input attributes. The process of finding an optimal algorithm and its control parameters for building a predictive model is a non-trivial process because of two reasons. The first reason is that the number of classification algorithms and its control parameters are very large. The second reason is that it can be quite time consuming to build a model for datasets containing a large number of records and attributes. These two reasons makes it impractical to enumerate through every algorithm and its possible control parameters for finding an optimal model. Genetic Algorithms are adaptive heuristic search algorithm and have been successfully applied to solve optimization problems in diverse domains. In this work, we formulate the problem of finding optimal predictive model building parameter as an optimization problem and examine the usefulness of genetic algorithms. We perform experiments on several datasets and report empirical results to show the applicability of genetic algorithms to the problem of finding optimal predictive model building parameters.