Performance enhancement of extreme learning machine for multi-category sparse data classification problems

Authors:
S. Suresh;S. Saraswathi;N. Sundararajan
Affiliations:
School of Computer Engineering, Nanyang Technological University, Singapore;Laurence H. Baker Center for Bioinformatics and Biological Statistics, Iowa State University, Ames, USA;School of Electrical and Electronics Engineering, Nanyang Technological University, Singapore
Venue:
Engineering Applications of Artificial Intelligence
Year:
2010

Citing 6
Cited 8

Genetic Algorithms Plus Data Structures Equals Evolution Programs

Genetic Algorithms Plus Data Structures Equals Evolution Programs
On Comparing Classifiers: Pitfalls toAvoid and a Recommended Approach

Data Mining and Knowledge Discovery
Rapid and brief communication: Evolutionary extreme learning machine

Pattern Recognition
Learning capability and storage capacity of two-hidden-layer feedforward networks

IEEE Transactions on Neural Networks
Real-time learning capability of neural networks

IEEE Transactions on Neural Networks
Universal approximation using incremental constructive feedforward networks with random hidden nodes

IEEE Transactions on Neural Networks

A sequential learning algorithm for self-adaptive resource allocation network classifier

Neurocomputing
ICGA-PSO-ELM Approach for Accurate Multiclass Cancer Classification Resulting in Reduced Gene Sets in Which Genes Encoding Secreted Proteins Are Highly Represented

IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Online learning neural tracker

Neurocomputing
Fast learning Circular Complex-valued Extreme Learning Machine (CC-ELM) for real-valued classification problems

Information Sciences: an International Journal
2012 Special Issue: Identification of brain regions responsible for Alzheimer's disease using a Self-adaptive Resource Allocation Network

Neural Networks
A novel approach for detection and classification of mammographic microcalcifications using wavelet analysis and extreme learning machine

Computers in Biology and Medicine
A study on the randomness reduction effect of extreme learning machine with ridge regression

ISNN'13 Proceedings of the 10th international conference on Advances in Neural Networks - Volume Part I
Predicting minority class for suspended particulate matters level by extreme learning machine

Neurocomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a performance enhancement scheme for the recently developed extreme learning machine (ELM) for multi-category sparse data classification problems. ELM is a single hidden layer neural network with good generalization capabilities and extremely fast learning capacity. In ELM, the input weights are randomly chosen and the output weights are analytically calculated. The generalization performance of the ELM algorithm for sparse data classification problem depends critically on three free parameters. They are, the number of hidden neurons, the input weights and the bias values which need to be optimally chosen. Selection of these parameters for the best performance of ELM involves a complex optimization problem. In this paper, we present a new, real-coded genetic algorithm approach called 'RCGA-ELM' to select the optimal number of hidden neurons, input weights and bias values which results in better performance. Two new genetic operators called 'network based operator' and 'weight based operator' are proposed to find a compact network with higher generalization performance. We also present an alternate and less computationally intensive approach called 'sparse-ELM'. Sparse-ELM searches for the best parameters of ELM using K-fold validation. A multi-class human cancer classification problem using micro-array gene expression data (which is sparse), is used for evaluating the performance of the two schemes. Results indicate that the proposed RCGA-ELM and sparse-ELM significantly improve ELM performance for sparse multi-category classification problems.