An evolutionary approach for achieving scalability with general regression neural networks

Authors:
Kenan Casey;Aaron Garrett;Joseph Gay;Lacey Montgomery;Gerry Dozier
Affiliations:
Department of Computer Science and Software Engineering, Auburn University, Auburn, USA;Department of Computer Science and Software Engineering, Auburn University, Auburn, USA;Department of Computer Science and Software Engineering, Auburn University, Auburn, USA;Department of Computer Science and Software Engineering, Auburn University, Auburn, USA;Department of Computer Science and Software Engineering, Auburn University, Auburn, USA
Venue:
Natural Computing: an international journal
Year:
2009

Citing 15
Cited 2

The nature of statistical learning theory

The nature of statistical learning theory
Elements of artificial neural networks

Elements of artificial neural networks
Making large-scale support vector machine learning practical

Advances in kernel methods
Learning to remove Internet advertisements

Proceedings of the third annual conference on Autonomous Agents
Searching in high-dimensional spaces: Index structures for improving the performance of multimedia databases

ACM Computing Surveys (CSUR)
Neural Networks

Neural Networks
Neural Networks: A Comprehensive Foundation

Neural Networks: A Comprehensive Foundation
Machine Learning

Machine Learning
Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation

Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation
Computational Intelligence: An Introduction

Computational Intelligence: An Introduction
A Tutorial on Support Vector Machines for Pattern Recognition

Data Mining and Knowledge Discovery
Support Vector Machines

IEEE Intelligent Systems
Estimation of Dependences Based on Empirical Data: Springer Series in Statistics (Springer Series in Statistics)

Estimation of Dependences Based on Empirical Data: Springer Series in Statistics (Springer Series in Statistics)
Mixed-integer optimization of coronary vessel image analysis using evolution strategies

Proceedings of the 8th annual conference on Genetic and evolutionary computation
Fast nonnegative matrix factorization and its application for protein fold recognition

EURASIP Journal on Applied Signal Processing

Conservative and aggressive rough SVR modeling

Theoretical Computer Science
Hybrid random subsample classifier ensemble for high dimensional data sets

International Journal of Hybrid Intelligent Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we present an approach to overcome the scalability issues associated with instance-based learners. Our system uses evolutionary computational techniques to determine the minimal set of training instances needed to achieve good classification accuracy with an instance-based learner. In this way, instance-based learners need not store all the training data available but instead store only those instances that are required for the desired accuracy. Additionally, we explore the utility of evolving the optimal feature set used by the learner for a given problem. In this way, we attempt to deal with the so-called "curse of dimensionality" associated with computational learning systems. To these ends, we introduce the Evolutionary General Regression Neural Network. This design uses an estimation of distribution algorithm to generate both the optimal training set as well as the optimal feature set for a general regression neural network. We compare its performance against a standard general regression neural network and an optimized support vector machine across four benchmark classification problems.