Multinomial logistic regression and product unit neural network models: Application of a new hybrid methodology for solving a classification problem in the livestock sector

Authors:
Mercedes Torres;Cesar Hervás;Carlos García
Affiliations:
Department of Management and Quantitative Methods, ETEA, Spain;Department of Computing and Numerical Analysis, University of Córdoba, Spain;Department of Management and Quantitative Methods, ETEA, Spain
Venue:
Expert Systems with Applications: An International Journal
Year:
2009

Citing 23
Cited 3

Product units: a computationally powerful and biologically plausible extension to backpropagation networks

Neural Computation
Machine learning: an artificial intelligence approach volume III

Machine learning: an artificial intelligence approach volume III
Technical note: some properties of splitting criteria

Machine Learning
Genetic Algorithms in Search, Optimization and Machine Learning

Genetic Algorithms in Search, Optimization and Machine Learning
Aggregating expert predictions in a networked environment

Computers and Operations Research
Induction of Decision Trees

Machine Learning
On the complexity of computing and learning with multiplicative neural networks

Neural Computation
Logistic regression and artificial neural network classification models: a methodology review

Journal of Biomedical Informatics
Accuracy-based learning classifier systems: models, analysis and applications to classification tasks

Evolutionary Computation
A threshold-varying artificial neural network approach for classification and its application to bankruptcy prediction problem

Computers and Operations Research
A neural network application to consumer classification to improve the timing of direct marketing activities

Computers and Operations Research
Employee turnover: a neural network solution

Computers and Operations Research
Approximating the sheep milk production curve through the use of artificial neural networks and genetic algorithms

Computers and Operations Research
Wavelet neural network classification of EEG signals by using AR model with MLE preprocessing

Neural Networks
Evolutionary product unit based neural networks for regression

Neural Networks
Biostatistical Analysis (5th Edition)

Biostatistical Analysis (5th Edition)
Multiclass sparse logistic regression for classification of multiple cancer types using gene expression data

Computational Statistics & Data Analysis
Logistic regression using covariates obtained by product-unit neural network models

Pattern Recognition
Review: Expert systems and evolutionary computing for financial investing: A review

Expert Systems with Applications: An International Journal
A novel hybrid learning algorithm for parametric fuzzy CMAC networks and its classification applications

Expert Systems with Applications: An International Journal
Mining the customer credit using classification and regression tree and multivariate adaptive regression splines

Computational Statistics & Data Analysis
Hybridization of evolutionary algorithms and local search by means of a clustering method

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Data classification with radial basis function networks based on a novel kernel density estimation algorithm

IEEE Transactions on Neural Networks

A logistic radial basis function regression method for discrimination of cover crops in olive orchards

Expert Systems with Applications: An International Journal
Determination of relative agrarian technical efficiency by a dynamic over-sampling procedure guided by minimum sensitivity

Expert Systems with Applications: An International Journal
Improvement of accuracy in a sound synthesis method using Evolutionary Product Unit Networks

Expert Systems with Applications: An International Journal

Quantified Score

Hi-index	12.06

Visualization

Abstract

This work presents a new approach for multi-class pattern recognition based on the hybridization of a linear and nonlinear model. We propose multinomial logistic regression where some new covariates are defined by a product unit neural network, where in turn, the nonlinear basis functions are constructed with the product of the inputs raised to arbitrary powers. The application of this methodology involves, first of all, training the coefficients and the basis structure of product unit models using techniques based on artificial neural networks and evolutionary algorithms, followed by the application of multinomial logistic regression to both the new derived features and the original ones. To evaluate the efficacy of our technique we pose a difficult problem, the classification of sheep with respect to their milk production in different lactations, using covariates that only involve the first weeks of lactation. This enables the productive capacity of the animal to be identified more rapidly and leads to a faster selection process in determining the best producers. The results obtained with our approach are compared to other classification methodologies. Although several of these methodologies offer good results, the percentage of cases correctly classified was higher with our approach, which shows how instrumental the potential use of this methodology is for decision making in livestock enterprises, a sector relatively untouched by the technological innovations in business management that have been appearing in the last few years.