OP-ELM: optimally pruned extreme learning machine

Authors:
Yoan Miche;Antti Sorjamaa;Patrick Bas;Olli Simula;Christian Jutten;Amaury Lendasse
Affiliations:
Gipsa-Lab, INPG, CNRS, Grenoble, France and Department of Information and Computer Science, Helsinki University of Technology, Espoo, Finland;Department of Information and Computer Science, Helsinki University of Technology, Espoo, Finland;Gipsa-Lab, INPG, CNRS, Grenoble, France;Department of Information and Computer Science, Helsinki University of Technology, Espoo, Finland;Gipsa-Lab, INPG, CNRS, Grenoble, France;Department of Information and Computer Science, Helsinki University of Technology, Espoo, Finland
Venue:
IEEE Transactions on Neural Networks
Year:
2010

Citing 9
Cited 38

Multilayer feedforward networks are universal approximators

Neural Networks
Neural Networks: A Comprehensive Foundation

Neural Networks: A Comprehensive Foundation
Neural Networks for Pattern Recognition

Neural Networks for Pattern Recognition
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond

Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Recursive Lazy Learning for Modeling and Control

ECML '98 Proceedings of the 10th European Conference on Machine Learning
Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning)

Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning)
A fast pruned-extreme learning machine for classification problem

Neurocomputing
Multiresponse sparse regression with application to multidimensional scaling

ICANN'05 Proceedings of the 15th international conference on Artificial neural networks: formal models and their applications - Volume Part II
Universal approximation using incremental constructive feedforward networks with random hidden nodes

IEEE Transactions on Neural Networks

A Group Selection Evolutionary Extreme Learning Machine approach for Time-Variant Neural Networks

Proceedings of the 2011 conference on Neural Nets WIRN10: Proceedings of the 20th Italian Workshop on Neural Nets
Batch intrinsic plasticity for extreme learning machines

ICANN'11 Proceedings of the 21th international conference on Artificial neural networks - Volume Part I
Weighting Efficient Accuracy and Minimum Sensitivity for Evolving Multi-Class Classifiers

Neural Processing Letters
Parameter estimation of q-Gaussian Radial Basis Functions Neural Networks with a Hybrid Algorithm for binary classification

Neurocomputing
Voting based extreme learning machine

Information Sciences: an International Journal
Comparing error minimized extreme learning machines and support vector sequential feed-forward neural networks

Neural Networks
An improved extreme learning machine based on particle swarm optimization

ICIC'11 Proceedings of the 7th international conference on Intelligent Computing: bio-inspired computing and applications
Applying least angle regression to ELM

Canadian AI'12 Proceedings of the 25th Canadian conference on Advances in Artificial Intelligence
A structure optimisation algorithm for feedforward neural network construction

Neurocomputing
A lossless copyright authentication scheme based on Bessel-Fourier moment and extreme learning machine in curvature-feature domain

Journal of Systems and Software
Architecture selection for networks trained with extreme learning machine using localized generalization error model

Neurocomputing
Regularized extreme learning machine for regression with missing data

Neurocomputing
Partitioned online sequential extreme learning machine for large ordered system modeling

Neurocomputing
Evolutionary extreme learning machine ensembles with size control

Neurocomputing
Feature selection for nonlinear models with extreme learning machines

Neurocomputing
Fast variable selection for memetracker phrases time series prediction

Proceedings of the 5th International Conference on PErvasive Technologies Related to Assistive Environments
Automatic and Adaptive Classification of Electroencephalographic Signals for Brain Computer Interfaces

Journal of Medical Systems
PCA-ELM: A Robust and Pruned Extreme Learning Machine Approach Based on Principal Component Analysis

Neural Processing Letters
Parallel Chaos Search Based Incremental Extreme Learning Machine

Neural Processing Letters
Extreme learning machine: a robust modeling technique? yes!

IWANN'13 Proceedings of the 12th international conference on Artificial Neural Networks: advances in computational intelligence - Volume Part I
Minimal learning machine: a new distance-based method for supervised learning

IWANN'13 Proceedings of the 12th international conference on Artificial Neural Networks: advances in computational intelligence - Volume Part I
A study on the randomness reduction effect of extreme learning machine with ridge regression

ISNN'13 Proceedings of the 10th international conference on Advances in Neural Networks - Volume Part I
Learning sparse representations for view-independent human action recognition based on fuzzy distances

Neurocomputing
Neural networks letter: Neural architecture design based on extreme learning machine

Neural Networks
Long-term time series prediction using OP-ELM

Neural Networks
1-Norm extreme learning machine for regression and multiclass classification using Newton method

Neurocomputing
Evolutionary ELM wrapper feature selection for Alzheimer's disease CAD on anatomical brain MRI

Neurocomputing
Bankruptcy prediction using Extreme Learning Machine and financial expertise

Neurocomputing
Constructive multi-output extreme learning machine with application to large tanker motion dynamics identification

Neurocomputing
Double parallel feedforward neural network based on extreme learning machine with L 1/2 regularizer

Neurocomputing
Extreme learning machines for soybean classification in remote sensing hyperspectral images

Neurocomputing
Extreme learning machine towards dynamic model hypothesis in fish ethology research

Neurocomputing
Ensemble delta test-extreme learning machine (DT-ELM) for regression

Neurocomputing
Learning of a single-hidden layer feedforward neural network using an optimized extreme learning machine

Neurocomputing
Optimized Parameter Search for Large Datasets of the Regularization Parameter and Feature Selection for Ridge Regression

Neural Processing Letters
Extreme Learning Machines for Feature Selection and Classification of Cocaine Dependent Patients on Structural MRI Data

Neural Processing Letters
Optimally pruned extreme learning machine with ensemble of regularization techniques and negative correlation penalty applied to automotive engine coldstart hydrocarbon emission identification

Neurocomputing
Quantifying the reliability of fault classifiers

Information Sciences: an International Journal

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this brief, the optimally pruned extreme learning machine (OP-ELM) methodology is presented. It is based on the original extreme learning machine (ELM) algorithm with additional steps to make it more robust and generic. The whole methodology is presented in detail and then applied to several regression and classification problems. Results for both computational time and accuracy (mean square error) are compared to the original ELM and to three other widely used methodologies: multilayer perceptron (MLP), support vector machine (SVM), and Gaussian process (GP). As the experiments for both regression and classification illustrate, the proposed OP-ELM methodology performs several orders of magnitude faster than the other algorithms used in this brief, except the original ELM. Despite the simplicity and fast performance, the OP-ELM is still able to maintain an accuracy that is comparable to the performance of the SVM. A toolbox for the OP-ELM is publicly available online.