Review article: A self-organizing map-based initialization for hybrid training of feedforward neural networks

  • Authors:
  • Mounir Ben Nasr;Mohamed Chtourou

  • Affiliations:
  • Research Unit on Intelligent Control, Design & Optimization of Complex Systems (ICOS), Department of Electrical Engineering, ENIS, BP W, 3038 Sfax, Tunisia;Research Unit on Intelligent Control, Design & Optimization of Complex Systems (ICOS), Department of Electrical Engineering, ENIS, BP W, 3038 Sfax, Tunisia

  • Venue:
  • Applied Soft Computing
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a novel hybrid algorithm for feedforward neural networks, called a self organizing map-based initialization for hybrid training based on a two stage learning approach. First stage, a structure learning scheme which includes adding hidden neurons is used to determine the network size. Second stage, a FN (fuzzy neighborhood)-based hybrid learning scheme which we have recently proposed is used to adjust the network parameters. In this approach the weights between input and hidden layers are firstly adjusted by Kohonen algorithm with fuzzy neighborhood, whereas the weights connecting hidden and output layers are adjusted using gradient descent method. Four simulation examples are provided to demonstrate the efficiency of the approach compared with other well-known and recently proposed learning methods.