Evolutionary product-unit neural networks classifiers

Authors:
F. J. Martínez-Estudillo;C. Hervás-Martínez;P. A. Gutiérrez;A. C. Martínez-Estudillo
Affiliations:
Department of Management and Quantitative Methods, ETEA, Escritor Castilla Aguayo 4, 14005 Córdoba, Spain;Department of Computer Science and Numerical Analysis, University of Córdoba, Campus de Rabanales, 14071 Córdoba, Spain;Department of Computer Science and Numerical Analysis, University of Córdoba, Campus de Rabanales, 14071 Córdoba, Spain;Department of Management and Quantitative Methods, ETEA, Escritor Castilla Aguayo 4, 14005 Córdoba, Spain
Venue:
Neurocomputing
Year:
2008

Citing 31
Cited 23

The annealing algorithm

The annealing algorithm
Product units: a computationally powerful and biologically plausible extension to backpropagation networks

Neural Computation
Evolutionary computation: toward a new philosophy of machine intelligence

Evolutionary computation: toward a new philosophy of machine intelligence
The nature of statistical learning theory

The nature of statistical learning theory
Classification using splines

Computational Statistics & Data Analysis
Neural Networks for Pattern Recognition

Neural Networks for Pattern Recognition
Training Product Unit Neural Networks with Genetic Algorithms

IEEE Expert: Intelligent Systems and Their Applications
Extracting regression rules from neural networks

Neural Networks
Designing Neural Networks using Genetic Algorithms

Proceedings of the 3rd International Conference on Genetic Algorithms
On the complexity of computing and learning with multiplicative neural networks

Neural Computation
Multilayer statistical classifiers

Computational Statistics & Data Analysis
Speeding up backpropagation using multiobjective evolutionary algorithms

Neural Computation
Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents

Evolutionary Computation
Evolutionary product unit based neural networks for regression

Neural Networks
Logistic regression using covariates obtained by product-unit neural network models

Pattern Recognition
Improving generalization of MLPs with sliding mode control and the Levenberg-Marquardt algorithm

Neurocomputing
JCLEC: a Java framework for evolutionary computation

Soft Computing - A Fusion of Foundations, Methodologies and Applications - Special issue (pp 315-357) "Ordered structures in many-valued logic"
Evolution of neural networks for classification and regression

Neurocomputing
Letters: Convex incremental extreme learning machine

Neurocomputing
KEEL: a software tool to assess evolutionary algorithms for data mining problems

Soft Computing - A Fusion of Foundations, Methodologies and Applications - Special Issue on Evolutionary and Metaheuristics based Data Mining (EMBDM); Guest Editors: José A. Gámez, María J. del Jesús, José M. Puerta
Evolving hybrid ensembles of learning machines for better generalisation

Neurocomputing
Applications of multi-objective structure optimization

Neurocomputing
Rapid and brief communication: Evolutionary extreme learning machine

Pattern Recognition
Making use of population information in evolutionary artificialneural networks

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Hybridization of evolutionary algorithms and local search by means of a clustering method

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
A new evolutionary system for evolving artificial neural networks

IEEE Transactions on Neural Networks
COVNET: a cooperative coevolutionary model for evolving artificial neural networks

IEEE Transactions on Neural Networks
Universal approximation using incremental constructive feedforward networks with random hidden nodes

IEEE Transactions on Neural Networks
Pruning algorithms-a survey

IEEE Transactions on Neural Networks
An evolutionary algorithm that constructs recurrent neural networks

IEEE Transactions on Neural Networks
Use of a quasi-Newton method in a feedforward neural network construction algorithm

IEEE Transactions on Neural Networks

Logistic regression product-unit neural networks for mapping Ridolfia segetum infestations in sunflower crop using multitemporal remote sensed data

Computers and Electronics in Agriculture
Combined projection and kernel basis functions for classification in evolutionary neural networks

Neurocomputing
A Sensitivity Clustering Method for Hybrid Evolutionary Algorithms

IWINAC '09 Proceedings of the 3rd International Work-Conference on The Interplay Between Natural and Artificial Computation: Part I: Methods and Models in Artificial and Natural Computation. A Homage to Professor Mira's Scientific Legacy
Hybrid Multilogistic Regression by Means of Evolutionary Radial Basis Functions: Application to Precision Agriculture

HAIS '09 Proceedings of the 4th International Conference on Hybrid Artificial Intelligence Systems
MultiLogistic regression using initial and radial basis function covariates

IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power

Information Sciences: an International Journal
Memetic Pareto Evolutionary Artificial Neural Networks to determine growth/no-growth in predictive microbiology

Applied Soft Computing
Classification by evolutionary generalised radial basis functions

International Journal of Hybrid Intelligent Systems - Advances in Intelligent Agent Systems
Evolutionary q-Gaussian Radial Basis Function Neural Network to determine the microbial growth/no growth interface of Staphylococcus aureus

Applied Soft Computing
A dynamic over-sampling procedure based on sensitivity for multi-class problems

Pattern Recognition
Determination of relative agrarian technical efficiency by a dynamic over-sampling procedure guided by minimum sensitivity

Expert Systems with Applications: An International Journal
Improving the accuracy of a two-stage algorithm in evolutionary product unit neural networks for classification by means of feature selection

IWINAC'11 Proceedings of the 4th international conference on Interplay between natural and artificial computation: new challenges on bioinspired applications - Volume Part II
Neural networks letter: Evolutionary q-Gaussian radial basis function neural networks for multiclassification

Neural Networks
Benchmarking IBHM method using NN3 competition dataset

HAIS'11 Proceedings of the 6th international conference on Hybrid artificial intelligent systems - Volume Part I
Parameter estimation of q-Gaussian Radial Basis Functions Neural Networks with a Hybrid Algorithm for binary classification

Neurocomputing
Evolutionary q-gaussian radial basis functions for binary-classification

HAIS'10 Proceedings of the 5th international conference on Hybrid Artificial Intelligence Systems - Volume Part II
A two-stage evolutionary algorithm based on sensitivity and accuracy for multi-class problems

Information Sciences: an International Journal
Evolutionary Generalized Radial Basis Function neural networks for improving prediction accuracy in gene classification using feature selection

Applied Soft Computing
Selection of evolutionary approach based hybrid data mining algorithms for decision support systems and business intelligence

Proceedings of the International Conference on Advances in Computing, Communications and Informatics
Improvement of accuracy in a sound synthesis method using Evolutionary Product Unit Networks

Expert Systems with Applications: An International Journal
A hybrid intelligent approach for modeling brand choice and constructing a market response simulator

Knowledge-Based Systems
Ensembles of evolutionary product unit or RBF neural networks for the identification of sound for pass-by noise test in vehicles

Neurocomputing
SimBa: A novel similarity-based crossover for neuro-evolution

Neurocomputing

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper proposes a classification method based on a special class of feed-forward neural network, namely product-unit neural networks. Product-units are based on multiplicative nodes instead of additive ones, where the nonlinear basis functions express the possible strong interactions between variables. We apply an evolutionary algorithm to determine the basic structure of the product-unit model and to estimate the coefficients of the model. We use softmax transformation as the decision rule and the cross-entropy error function because of its probabilistic interpretation. The approach can be seen as nonlinear multinomial logistic regression where the parameters are estimated using evolutionary computation. The empirical and specific multiple comparison statistical test results, carried out over several benchmark data sets and a complex real microbial Listeria growth/no growth problem, show that the proposed model is promising in terms of its classification accuracy and the number of the model coefficients, yielding a state-of-the-art performance.