Progressive interactive training: A sequential neural network ensemble learning method

Authors:
M. A. H. Akhand;Md. Monirul Islam;K. Murase
Affiliations:
Department of Computer Science and Engineering, Khulna University of Engineering and Technology (KUET), Khulna 9203, Bangladesh;Department of Human and Artificial Intelligence Systems, Graduate School of Engineering, University of Fukui, 3-9-1 Bunkyo, Fukui 910-8507, Japan;Department of Human and Artificial Intelligence Systems, Graduate School of Engineering, University of Fukui, 3-9-1 Bunkyo, Fukui 910-8507, Japan
Venue:
Neurocomputing
Year:
2009

Citing 13
Cited 2

Bagging predictors

Machine Learning
The Random Subspace Method for Constructing Decision Forests

IEEE Transactions on Pattern Analysis and Machine Intelligence
Swarm intelligence: from natural to artificial systems

Swarm intelligence: from natural to artificial systems
Ensemble learning via negative correlation

Neural Networks
Neural Networks: A Comprehensive Foundation

Neural Networks: A Comprehensive Foundation
An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants

Machine Learning
Neural Network Ensembles

IEEE Transactions on Pattern Analysis and Machine Intelligence
Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy

Machine Learning
Combining diverse neural nets

The Knowledge Engineering Review
Bagging, boosting, and C4.S

AAAI'96 Proceedings of the thirteenth national conference on Artificial intelligence - Volume 1
Generate different neural networks by negative correlation learning

ICNC'05 Proceedings of the First international conference on Advances in Natural Computation - Volume Part I
Simultaneous training of negatively correlated neural networks inan ensemble

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
A constructive algorithm for training cooperative neural network ensembles

IEEE Transactions on Neural Networks

From local neural networks to granular neural networks: A study in information granulation

Neurocomputing
Training regression ensembles by sequential target correction and resampling

Information Sciences: an International Journal

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper introduces a progressive interactive training scheme (PITS) for neural network (NN) ensembles. The scheme trains NNs in an ensemble one by one in a sequential fashion where the outputs of all previously trained NNs are stored and updated in a common location, called information center (IC). The communication among NNs is maintained indirectly through IC, reducing interaction among NNs. In this study, PITS is formulated as a derivative of simultaneous interactive training, negative correlation learning. The effectiveness of PITS is evaluated on a suite of 20 benchmark classification problems. The experimental results show that the proposed training scheme can improve the performance of ensembles. Furthermore, the PITS is incorporated with two very popular ensemble training methods, bagging and boosting. It is found that the performance of bagging and boosting algorithms can be improved by incorporating PITS with their training processes.