Letters: Convex incremental extreme learning machine

Authors:
Guang-Bin Huang;Lei Chen
Affiliations:
School of Electrical and Electronic Engineering, Nanyang Technological University, Nanyang Avenue, Singapore 639798, Singapore;School of Electrical and Electronic Engineering, Nanyang Technological University, Nanyang Avenue, Singapore 639798, Singapore and School of Computing, National University of Singapore, 3 Science ...
Venue:
Neurocomputing
Year:
2007

Citing 15
Cited 80

Approximation capabilities of multilayer feedforward networks

Neural Networks
A resource-allocating network for function interpolation

Neural Computation
Universal approximation using radial-basis-function networks

Neural Computation
Original Contribution: Multilayer feedforward networks with a nonpolynomial activation function can approximate any function

Neural Networks
A sequential learning scheme for function approximation using minimal radial basis function neural networks

Neural Computation
Effiicient BackProp

Neural Networks: Tricks of the Trade, this book is an outgrowth of a 1996 NIPS workshop
Approximation by fully complex multilayer perceptrons

Neural Computation
Letters: Fully complex extreme learning machine

Neurocomputing
The wavelet transform, time-frequency localization and signal analysis

IEEE Transactions on Information Theory
Universal approximation bounds for superpositions of a sigmoidal function

IEEE Transactions on Information Theory
Hinging hyperplanes for regression, classification, and function approximation

IEEE Transactions on Information Theory
Objective functions for training new hidden units in constructive neural networks

IEEE Transactions on Neural Networks
Real-time learning capability of neural networks

IEEE Transactions on Neural Networks
Universal approximation using incremental constructive feedforward networks with random hidden nodes

IEEE Transactions on Neural Networks
A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks

IEEE Transactions on Neural Networks

Incremental extreme learning machine with fully complex hidden nodes

Neurocomputing
Error-driven active learning in growing radial basis function networks for early robot learning

Neurocomputing
Letters: Neural networks stabilization and disturbance attenuation for nonlinear switched impulsive systems

Neurocomputing
Enhanced random search based incremental extreme learning machine

Neurocomputing
Convergence analysis of convex incremental neural networks

Annals of Mathematics and Artificial Intelligence
A fast pruned-extreme learning machine for classification problem

Neurocomputing
Evolutionary product-unit neural networks classifiers

Neurocomputing
A protein secondary structure prediction framework based on the Extreme Learning Machine

Neurocomputing
Simplified neural networks algorithm for function approximation on discrete input spaces in high dimension-limited sample applications

Neurocomputing
Brief paper: An adaptive optimization scheme with satisfactory transient performance

Automatica (Journal of IFAC)
γ-C plane and robustness in static reservoir for nonlinear regression estimation

Neurocomputing
Systemical convergence rate analysis of convex incremental feedforward neural networks

Neurocomputing
Approximation capabilities of multilayer fuzzy neural networks on the set of fuzzy-valued functions

Information Sciences: an International Journal
Partial Lanczos extreme learning machine for single-output regression problems

Neurocomputing
Online sequential fuzzy extreme learning machine for function approximation and classification problems

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics - Special issue on cybernetics and cognitive informatics
Large scale nonlinear control system fine-tuning through learning

IEEE Transactions on Neural Networks
Error minimized extreme learning machine with growth of hidden nodes and incremental learning

IEEE Transactions on Neural Networks
A constructive enhancement for online sequential extreme learning machine

IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Composite function wavelet neural networks with extreme learning machine

Neurocomputing
POFGEC: growing neural network of classifying potential function generators

International Journal of Knowledge Engineering and Soft Data Paradigms
OP-KNN: method and applications

Advances in Artificial Neural Systems
Constructive approximation to multivariate function by decay RBF neural network

IEEE Transactions on Neural Networks
A sequential learning algorithm for self-adaptive resource allocation network classifier

Neurocomputing
Two-stage extreme learning machine for regression

Neurocomputing
Constructive hidden nodes selection of extreme learning machine for regression

Neurocomputing
Optimization method based extreme learning machine for classification

Neurocomputing
Ordinal extreme learning machine

Neurocomputing
Approximation capability of interpolation neural networks

Neurocomputing
Approximation of functions with spatial inhomogeneity based on "true" ortho-ridgelet neural network

Applied Soft Computing
The multidimensional function approximation based on constructive wavelet RBF neural network

Applied Soft Computing
Extreme and incremental learning based single-hidden-layer regularization ridgelet network

Neurocomputing
Extreme learning machine with adaptive growth of hidden nodes and incremental updating of output weights

AIS'11 Proceedings of the Second international conference on Autonomous and intelligent systems
Face recognition based on kernelized extreme learning machine

AIS'11 Proceedings of the Second international conference on Autonomous and intelligent systems
Parameter estimation of q-Gaussian Radial Basis Functions Neural Networks with a Hybrid Algorithm for binary classification

Neurocomputing
Voting based extreme learning machine

Information Sciences: an International Journal
Letters: Daily maximum load forecasting of consecutive national holidays using OSELM-based multi-agents system with weighted average strategy

Neurocomputing
A comparative analysis of support vector machines and extreme learning machines

Neural Networks
A new automatic target recognition system based on wavelet extreme learning machine

Expert Systems with Applications: An International Journal
Modeling spectral data based on mutual information and kernel extreme learning machines

ISNN'12 Proceedings of the 9th international conference on Advances in Neural Networks - Volume Part I
Applying least angle regression to ELM

Canadian AI'12 Proceedings of the 25th Canadian conference on Advances in Artificial Intelligence
A novel locally regularized automatic construction method for RBF neural models

Neurocomputing
Weighted extreme learning machine for imbalance learning

Neurocomputing
Architecture selection for networks trained with extreme learning machine using localized generalization error model

Neurocomputing
Parallel extreme learning machine for regression based on MapReduce

Neurocomputing
Partitioned online sequential extreme learning machine for large ordered system modeling

Neurocomputing
Image classification based on effective extreme learning machine

Neurocomputing
EEG-based vigilance estimation using extreme learning machines

Neurocomputing
Extreme learning machine based wind speed estimation and sensorless control for wind turbine power generation system

Neurocomputing
Semantic concept detection for video based on extreme learning machine

Neurocomputing
Optimizing extreme learning machines via ridge regression and batch intrinsic plasticity

Neurocomputing
Comparing studies of learning methods for human face gender recognition

CCBR'12 Proceedings of the 7th Chinese conference on Biometric Recognition
PCA-ELM: A Robust and Pruned Extreme Learning Machine Approach Based on Principal Component Analysis

Neural Processing Letters
Parallel Chaos Search Based Incremental Extreme Learning Machine

Neural Processing Letters
Extreme learning machine: a robust modeling technique? yes!

IWANN'13 Proceedings of the 12th international conference on Artificial Neural Networks: advances in computational intelligence - Volume Part I
Learning sparse representations for view-independent human action recognition based on fuzzy distances

Neurocomputing
Neural networks letter: Neural architecture design based on extreme learning machine

Neural Networks
Neural networks letter: Comments on the "No-Prop" algorithm

Neural Networks
A new constructive neural network method for noise processing and its application on stock market prediction

Applied Soft Computing
A hierarchical structure of extreme learning machine (HELM) for high-dimensional datasets with noise

Neurocomputing
Review and performance comparison of SVM- and ELM-based classifiers

Neurocomputing
1-Norm extreme learning machine for regression and multiclass classification using Newton method

Neurocomputing
Parallelized extreme learning machine ensemble based on min-max modular network

Neurocomputing
Evolutionary ELM wrapper feature selection for Alzheimer's disease CAD on anatomical brain MRI

Neurocomputing
Bankruptcy prediction using Extreme Learning Machine and financial expertise

Neurocomputing
Constructive multi-output extreme learning machine with application to large tanker motion dynamics identification

Neurocomputing
Meta-ELM: ELM with ELM hidden nodes

Neurocomputing
Clustering in extreme learning machine feature space

Neurocomputing
Fast sparse approximation of extreme learning machine

Neurocomputing
Double parallel feedforward neural network based on extreme learning machine with L 1/2 regularizer

Neurocomputing
Breast tumor detection in digital mammography based on extreme learning machine

Neurocomputing
Extreme learning machines for soybean classification in remote sensing hyperspectral images

Neurocomputing
2-D defect profile reconstruction from ultrasonic guided wave signals based on QGA-kernelized ELM

Neurocomputing
Discrete-time hypersonic flight control based on extreme learning machine

Neurocomputing
Predicting pupylation sites in prokaryotic proteins using pseudo-amino acid composition and extreme learning machine

Neurocomputing
Extreme learning machine towards dynamic model hypothesis in fish ethology research

Neurocomputing
Ensemble delta test-extreme learning machine (DT-ELM) for regression

Neurocomputing
Extreme Learning Machines for Feature Selection and Classification of Cocaine Dependent Patients on Structural MRI Data

Neural Processing Letters
Hybrid extreme rotation forest

Neural Networks
Learning to Rank with Extreme Learning Machine

Neural Processing Letters
Applications of Hybrid Extreme Rotation Forests for image segmentation

International Journal of Hybrid Intelligent Systems

Quantified Score

Hi-index	0.02

Visualization

Abstract

Unlike the conventional neural network theories and implementations, Huang et al. [Universal approximation using incremental constructive feedforward networks with random hidden nodes, IEEE Transactions on Neural Networks 17(4) (2006) 879-892] have recently proposed a new theory to show that single-hidden-layer feedforward networks (SLFNs) with randomly generated additive or radial basis function (RBF) hidden nodes (according to any continuous sampling distribution) can work as universal approximators and the resulting incremental extreme learning machine (I-ELM) outperforms many popular learning algorithms. I-ELM randomly generates the hidden nodes and analytically calculates the output weights of SLFNs, however, I-ELM does not recalculate the output weights of all the existing nodes when a new node is added. This paper shows that while retaining the same simplicity, the convergence rate of I-ELM can be further improved by recalculating the output weights of the existing nodes based on a convex optimization method when a new hidden node is randomly added. Furthermore, we show that given a type of piecewise continuous computational hidden nodes (possibly not neural alike nodes), if SLFNs f"n(x)=@?i=1n@b"iG(x,a"i,b"i) can work as universal approximators with adjustable hidden node parameters, from a function approximation point of view the hidden node parameters of such ''generalized'' SLFNs (including sigmoid networks, RBF networks, trigonometric networks, threshold networks, fuzzy inference systems, fully complex neural networks, high-order networks, ridge polynomial networks, wavelet networks, etc.) can actually be randomly generated according to any continuous sampling distribution. In theory, the parameters of these SLFNs can be analytically determined by ELM instead of being tuned.