Letters: Regularized extreme learning machine for regression problems

  • Authors:

  • José M. MartíNez-MartíNez;Pablo Escandell-Montero;Emilio Soria-Olivas;José D. MartíN-Guerrero;Rafael Magdalena-Benedito;Juan GóMez-Sanchis

  • Affiliations:

  • Electronic Engineering Department, University of Valencia, C/Dr Moliner 50, 46100 Burjassot, Valencia, Spain;Electronic Engineering Department, University of Valencia, C/Dr Moliner 50, 46100 Burjassot, Valencia, Spain;Electronic Engineering Department, University of Valencia, C/Dr Moliner 50, 46100 Burjassot, Valencia, Spain;Electronic Engineering Department, University of Valencia, C/Dr Moliner 50, 46100 Burjassot, Valencia, Spain;Electronic Engineering Department, University of Valencia, C/Dr Moliner 50, 46100 Burjassot, Valencia, Spain;Electronic Engineering Department, University of Valencia, C/Dr Moliner 50, 46100 Burjassot, Valencia, Spain

  • Venue:
  • Neurocomputing
  • Year:
  • 2011

Quantified Score

Hi-index 0.01

Visualization

Abstract

Extreme learning machine (ELM) is a new learning algorithm for single-hidden layer feedforward networks (SLFNs) proposed by Huang et al. [1]. Its main advantage is the lower computational cost, which is especially relevant when dealing with many patterns defined in a high-dimensional space. This paper proposes an algorithm for pruning ELM networks by using regularized regression methods, thus obtaining a suitable number of the hidden nodes in the network architecture. Beginning from an initial large number of hidden nodes, irrelevant nodes are then pruned using ridge regression, elastic net and lasso methods; hence, the architectural design of ELM network can be automated. Empirical studies on several commonly used regression benchmark problems show that the proposed approach leads to compact networks that generate competitive results compared with the ELM algorithm.