Comparing logistic regression, neural networks, c5.0 and m5′ classification techniques

Authors:
Amit Thombre
Affiliations:
Centre of Excellence, Tech Mahindra, Pune, India
Venue:
MLDM'12 Proceedings of the 8th international conference on Machine Learning and Data Mining in Pattern Recognition
Year:
2012

Citing 9
Cited 0

Use of an artificial neural network for data analysis in clinical decision-making: the diagnosis of acute coronary occlusion

Neural Computation
Using Model Trees for Classification

Machine Learning
Feedforward Neural Network Construction Using Cross Validation

Neural Computation
Logistic regression for disease classification using microarray data

Bioinformatics
2008 Special Issue: Training neural network classifiers for medical decision making: The effects of imbalanced datasets on classification performance

Neural Networks
Neural networks for classification: a survey

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
CARVE-a constructive algorithm for real-valued examples

IEEE Transactions on Neural Networks
Bankruptcy prediction for credit risk using neural networks: A survey and new results

IEEE Transactions on Neural Networks
Continuous speech recognition by connectionist statistical methods

IEEE Transactions on Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

The aim of the paper is to compare the prediction accuracies obtained using logistic regression, neural networks (NN), C5.0 and M5′ classification techniques on 4 freely available data sets. For this a feedforward neural network with a single hidden layer and using back propagation is built using a new algorithm. The results show that the training accuracies obtained using the new algorithm are better than that obtained using N2C2S algorithm. The cross-validation accuracies and the test prediction accuracies obtained by using both the algorithms are not statistically significantly different. Due to this and also since it is easy to understand and implement than N2C2S algorithm, the proposed algorithm should be preferred than the N2C2S algorithm. Along with this 3 different methods of obtaining weights for neural networks are also compared. The classification results show that NN is better than logistic regression over 2 data sets, equivalent in performance over 2 data sets and has low performance than logistic regression in case of 1 data set. It is observed that M5′ is a better classification technique than other techniques over 1 dataset.