An associative sparse coding neural network and applications

Authors:
Xianhua Zeng;Siwei Luo;Qingyong Li
Affiliations:
College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, PR China;School of Computer and Information Technology, Beijing Jiaotong University, Beijing 100044, PR China;School of Computer and Information Technology, Beijing Jiaotong University, Beijing 100044, PR China
Venue:
Neurocomputing
Year:
2010

Citing 2
Cited 1

What is the goal of sensory coding?

Neural Computation
Learning Overcomplete Representations

Neural Computation

Two Expectation-Maximization algorithms for Boolean Factor Analysis

Neurocomputing

Quantified Score

Hi-index	0.01

Visualization

Abstract

Some linear sparse coding models have been proposed for modeling responses in the early stage of the visual system, but nonlinear operations are ubiquitous in visual cortex. So we put forward an associative sparse coding neural network (ASCNN) with nonlinear response property in top-layer coding units. In our ASCNN model, the choices of sparseness function must correspond to the characters of activation function. This paper gives several reasonable and efficient methods for constructing sparseness functions and activation functions. Experiment on benchmark natural image dataset shows that our model can successfully simulate receptive field and nonlinear sparse response property of simple cells. Moreover, in two recognition tasks on face images and handwritten digits, experimental results show that our model works much better than linear sparse coding model (Sparsenet) by combining with linear neural network classifier.