Enhanced random search based incremental extreme learning machine

Authors:
Guang-Bin Huang;Lei Chen
Affiliations:
School of Electrical and Electronic Engineering, Nanyang Technological University, Nanyang Avenue, Singapore 639798, Singapore;School of Electrical and Electronic Engineering, Nanyang Technological University, Nanyang Avenue, Singapore 639798, Singapore and School of Computing, National University of Singapore, 3 Science ...
Venue:
Neurocomputing
Year:
2008

Citing 12
Cited 75

Universal approximation using radial-basis-function networks

Neural Computation
Original Contribution: Multilayer feedforward networks with a nonpolynomial activation function can approximate any function

Neural Networks
Approximation by fully complex multilayer perceptrons

Neural Computation
Letters: Convex incremental extreme learning machine

Neurocomputing
Incremental extreme learning machine with fully complex hidden nodes

Neurocomputing
Letters: Fully complex extreme learning machine

Neurocomputing
The wavelet transform, time-frequency localization and signal analysis

IEEE Transactions on Information Theory
Hinging hyperplanes for regression, classification, and function approximation

IEEE Transactions on Information Theory
Objective functions for training new hidden units in constructive neural networks

IEEE Transactions on Neural Networks
Real-time learning capability of neural networks

IEEE Transactions on Neural Networks
Universal approximation using incremental constructive feedforward networks with random hidden nodes

IEEE Transactions on Neural Networks
A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks

IEEE Transactions on Neural Networks

Fully complex-valued radial basis function networks: Orthogonal least squares regression and classification

Neurocomputing
γ-C plane and robustness in static reservoir for nonlinear regression estimation

Neurocomputing
Partial Lanczos extreme learning machine for single-output regression problems

Neurocomputing
Real-Time Collaborative Filtering Using Extreme Learning Machine

WI-IAT '09 Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology - Volume 01
A constructive enhancement for online sequential extreme learning machine

IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Composite function wavelet neural networks with extreme learning machine

Neurocomputing
POFGEC: growing neural network of classifying potential function generators

International Journal of Knowledge Engineering and Soft Data Paradigms
Constructive approximation to multivariate function by decay RBF neural network

IEEE Transactions on Neural Networks
Two-stage extreme learning machine for regression

Neurocomputing
Constructive hidden nodes selection of extreme learning machine for regression

Neurocomputing
Incremental-based extreme learning machine algorithms for time-variant neural networks

ICIC'10 Proceedings of the 6th international conference on Advanced intelligent computing theories and applications: intelligent computing
Optimization method based extreme learning machine for classification

Neurocomputing
Ordinal extreme learning machine

Neurocomputing
Approximation capability of interpolation neural networks

Neurocomputing
The multidimensional function approximation based on constructive wavelet RBF neural network

Applied Soft Computing
ELM-Based time-variant neural networks with incremental number of output basis functions

ISNN'11 Proceedings of the 8th international conference on Advances in neural networks - Volume Part I
Extreme learning machine with adaptive growth of hidden nodes and incremental updating of output weights

AIS'11 Proceedings of the Second international conference on Autonomous and intelligent systems
Face recognition based on kernelized extreme learning machine

AIS'11 Proceedings of the Second international conference on Autonomous and intelligent systems
Voting based extreme learning machine

Information Sciences: an International Journal
Letters: Daily maximum load forecasting of consecutive national holidays using OSELM-based multi-agents system with weighted average strategy

Neurocomputing
Efficient and effective algorithms for training single-hidden-layer neural networks

Pattern Recognition Letters
Enhanced extreme learning machine with modified gram-schmidt algorithm

ISNN'10 Proceedings of the 7th international conference on Advances in Neural Networks - Volume Part I
A comparative analysis of support vector machines and extreme learning machines

Neural Networks
A new automatic target recognition system based on wavelet extreme learning machine

Expert Systems with Applications: An International Journal
Modeling spectral data based on mutual information and kernel extreme learning machines

ISNN'12 Proceedings of the 9th international conference on Advances in Neural Networks - Volume Part I
Multi-class classification with one-against-one using probabilistic extreme learning machine

ISNN'12 Proceedings of the 9th international conference on Advances in Neural Networks - Volume Part II
Applying least angle regression to ELM

Canadian AI'12 Proceedings of the 25th Canadian conference on Advances in Artificial Intelligence
A novel locally regularized automatic construction method for RBF neural models

Neurocomputing
An incremental neural network with a reduced architecture

Neural Networks
A structure optimisation algorithm for feedforward neural network construction

Neurocomputing
Fashion retailing forecasting based on extreme learning machine with adaptive metrics of inputs

Knowledge-Based Systems
Weighted extreme learning machine for imbalance learning

Neurocomputing
Architecture selection for networks trained with extreme learning machine using localized generalization error model

Neurocomputing
Robust extreme learning machine

Neurocomputing
Regularized extreme learning machine for regression with missing data

Neurocomputing
Parallel extreme learning machine for regression based on MapReduce

Neurocomputing
Partitioned online sequential extreme learning machine for large ordered system modeling

Neurocomputing
An online learning network for biometric scores fusion

Neurocomputing
Circular-ELM for the reduced-reference assessment of perceived image quality

Neurocomputing
Image classification based on effective extreme learning machine

Neurocomputing
Feature selection for nonlinear models with extreme learning machines

Neurocomputing
EEG-based vigilance estimation using extreme learning machines

Neurocomputing
Extreme learning machine based genetic algorithm and its application in power system economic dispatch

Neurocomputing
Extreme learning machine based wind speed estimation and sensorless control for wind turbine power generation system

Neurocomputing
Semantic concept detection for video based on extreme learning machine

Neurocomputing
Multiple extreme learning machines for a two-class imbalance corporate life cycle prediction

Knowledge-Based Systems
Comparing studies of learning methods for human face gender recognition

CCBR'12 Proceedings of the 7th Chinese conference on Biometric Recognition
A multi-objective micro genetic ELM algorithm

Neurocomputing
Efficient self-organizing multilayer neural network for nonlinear system modeling

Neural Networks
PCA-ELM: A Robust and Pruned Extreme Learning Machine Approach Based on Principal Component Analysis

Neural Processing Letters
Parallel Chaos Search Based Incremental Extreme Learning Machine

Neural Processing Letters
Extreme learning machine: a robust modeling technique? yes!

IWANN'13 Proceedings of the 12th international conference on Artificial Neural Networks: advances in computational intelligence - Volume Part I
Context-aware Discriminative Vocabulary Tree Learning for mobile landmark recognition

Digital Signal Processing
Direct Kernel Perceptron (DKP): Ultra-fast kernel ELM-based classification with non-iterative closed-form weight calculation

Neural Networks
A hierarchical structure of extreme learning machine (HELM) for high-dimensional datasets with noise

Neurocomputing
Review and performance comparison of SVM- and ELM-based classifiers

Neurocomputing
1-Norm extreme learning machine for regression and multiclass classification using Newton method

Neurocomputing
Parallelized extreme learning machine ensemble based on min-max modular network

Neurocomputing
Evolutionary ELM wrapper feature selection for Alzheimer's disease CAD on anatomical brain MRI

Neurocomputing
Bankruptcy prediction using Extreme Learning Machine and financial expertise

Neurocomputing
Constructive multi-output extreme learning machine with application to large tanker motion dynamics identification

Neurocomputing
Meta-ELM: ELM with ELM hidden nodes

Neurocomputing
Clustering in extreme learning machine feature space

Neurocomputing
Double parallel feedforward neural network based on extreme learning machine with L 1/2 regularizer

Neurocomputing
Breast tumor detection in digital mammography based on extreme learning machine

Neurocomputing
Extreme learning machines for soybean classification in remote sensing hyperspectral images

Neurocomputing
2-D defect profile reconstruction from ultrasonic guided wave signals based on QGA-kernelized ELM

Neurocomputing
Predicting pupylation sites in prokaryotic proteins using pseudo-amino acid composition and extreme learning machine

Neurocomputing
Extreme learning machine towards dynamic model hypothesis in fish ethology research

Neurocomputing
Comparing the learning effectiveness of BP, ELM, I-ELM, and SVM for corporate credit ratings

Neurocomputing
Ensemble delta test-extreme learning machine (DT-ELM) for regression

Neurocomputing
Optimally pruned extreme learning machine with ensemble of regularization techniques and negative correlation penalty applied to automotive engine coldstart hydrocarbon emission identification

Neurocomputing
Hybrid extreme rotation forest

Neural Networks
Learning to Rank with Extreme Learning Machine

Neural Processing Letters
Applications of Hybrid Extreme Rotation Forests for image segmentation

International Journal of Hybrid Intelligent Systems

Quantified Score

Hi-index	0.01

Visualization

Abstract

Recently an incremental algorithm referred to as incremental extreme learning machine (I-ELM) was proposed by Huang et al. [G.-B. Huang, L. Chen, C.-K. Siew, Universal approximation using incremental constructive feedforward networks with random hidden nodes, IEEE Trans. Neural Networks 17(4) (2006) 879-892], which randomly generates hidden nodes and then analytically determines the output weights. Huang et al. [G.-B. Huang, L. Chen, C.-K. Siew, Universal approximation using incremental constructive feedforward networks with random hidden nodes, IEEE Trans. Neural Networks 17(4) (2006) 879-892] have proved in theory that although additive or RBF hidden nodes are generated randomly the network constructed by I-ELM can work as a universal approximator. During our recent study, it is found that some of the hidden nodes in such networks may play a very minor role in the network output and thus may eventually increase the network complexity. In order to avoid this issue and to obtain a more compact network architecture, this paper proposes an enhanced method for I-ELM (referred to as EI-ELM). At each learning step, several hidden nodes are randomly generated and among them the hidden node leading to the largest residual error decreasing will be added to the existing network and the output weight of the network will be calculated in a same simple way as in the original I-ELM. Generally speaking, the proposed enhanced I-ELM works for the widespread type of piecewise continuous hidden nodes.