A network for recursive extraction of canonical coordinates

  • Authors:
  • Ali Pezeshki;Mahmood R. Azimi-Sadjadi;Louis L. Scharf

  • Affiliations:
  • Department of Electrical and Computer Engineering, Colorado State University, Fort Collins, CO;Department of Electrical and Computer Engineering, Colorado State University, Fort Collins, CO;Department of Electrical and Computer Engineering, Colorado State University, Fort Collins, CO

  • Venue:
  • Neural Networks - 2003 Special issue: Advances in neural networks research — IJCNN'03
  • Year:
  • 2003

Quantified Score

Hi-index 0.01

Visualization

Abstract

A network structure for canonical coordinate decomposition is presented. The network consists of two single-layer linear subnetworks that together extract the canonical coordinates of two data channels. The connection weights of the networks are trained by a stochastic gradient descent learning algorithm. Each subnetwork features a hierarchical set of lateral connections among its outputs. The lateral connections perform a deflation process that subtracts the contributions of the already extracted coordinates from the input data subspace. This structure allows for adding new nodes for extracting additional canonical coordinates without the need for retraining the previous nodes. The performance of the network is evaluated on a synthesized data set.