MultiLogistic regression using initial and radial basis function covariates

Authors:
Pedro Antonio Gutiérrez;César Hervás-Martínez;Francisco J. Martínez-Estudillo;Juan Carlos Fernández
Affiliations:
Department of Computer Science and Numerical Analysis, University of Córdoba, Córdoba, Spain;Department of Computer Science and Numerical Analysis, University of Córdoba, Córdoba, Spain;Department of Management and Quantitative Methods, ETEA, Córdoba, Spain;Department of Computer Science and Numerical Analysis, University of Córdoba, Córdoba, Spain
Venue:
IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Year:
2009

Citing 15
Cited 0

Multiple comparison procedures

Multiple comparison procedures
Introduction to statistical pattern recognition (2nd ed.)

Introduction to statistical pattern recognition (2nd ed.)
A Gaussian potential function network with hierarchically self-organizing learning

Neural Networks
Universal approximation using radial-basis-function networks

Neural Computation
Aggregating expert predictions in a networked environment

Computers and Operations Research
Logistic Model Trees

Machine Learning
Pattern Recognition and Machine Learning (Information Science and Statistics)

Pattern Recognition and Machine Learning (Information Science and Statistics)
Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)

Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)
Logistic regression using covariates obtained by product-unit neural network models

Pattern Recognition
JCLEC: a Java framework for evolutionary computation

Soft Computing - A Fusion of Foundations, Methodologies and Applications - Special issue (pp 315-357) "Ordered structures in many-valued logic"
Fast learning in networks of locally-tuned processing units

Neural Computation
Multilogistic regression by means of evolutionary product-unit neural networks

Neural Networks
Evolutionary product-unit neural networks classifiers

Neurocomputing
DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction

IEEE Transactions on Fuzzy Systems
A new evolutionary system for evolving artificial neural networks

IEEE Transactions on Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper proposes a hybrid multilogistic model, named MultiLogistic Regression using Initial and Radial Basis Function covariates (MLRIRBF). The process for obtaining the coefficients is carried out in several steps. First, an Evolutionary Programming (EP) algorithm is applied, aimed to produce a RBF Neural Network (RBFNN) with a reduced number of RBF transformations and the simplest structure possible. Then, the input space is transformed by adding the nonlinear transformations of the input variables given by the RBFs of the best individual in the last generation. Finally, a maximum likelihood optimization method determines the coefficients associated with a multilogistic regression model built on this transformed input space. In this final step, two different multilogistic regression algorithms are applied, one that considers all initial and RBF covariates (MLRIRBF) and another one that incrementally constructs the model and applies cross-validation, resulting in an automatic covariate selection (MLRIRBF*). The methodology proposed is tested using six benchmark classification problems from well-known machine learning problems. The results are compared with the corresponding multilogistic regression methodologies applied over the initial input space, to the RBFNNs obtained by the EP algorithm (RBFEP) and to other competitive machine learning techniques. The MLRIRBF* models are found to be better than the corresponding multilogistic regression methodologies and the RBFEP method for almost all datasets, and obtain the highest mean accuracy rank when compared to the rest of methods in all datasets.