Evolving spiking neural networks for audiovisual information processing

Authors:
Simei Gomes Wysoski;Lubica Benuskova;Nikola Kasabov
Affiliations:
Knowledge Engineering and Discovery Research Institute,11http://www.kedri.info. Auckland University of Technology, 1051 Auckland, New Zealand;Knowledge Engineering and Discovery Research Institute,11http://www.kedri.info. Auckland University of Technology, 1051 Auckland, New Zealand and Department of Computer Science, University of Otag ...;Knowledge Engineering and Discovery Research Institute,11http://www.kedri.info. Auckland University of Technology, 1051 Auckland, New Zealand
Venue:
Neural Networks
Year:
2010

Citing 18
Cited 11

Neural network learning and expert systems

Neural network learning and expert systems
Fundamentals of speech recognition

Fundamentals of speech recognition
SEEMORE: combining color, shape, and texture histogramming in a neurally inspired approach to visual object recognition

Neural Computation
On Combining Classifiers

IEEE Transactions on Pattern Analysis and Machine Intelligence
Encoding information in neuronal activity

Pulsed neural networks
A self-supervised learning system for pattern recognition by sensory integration

Neural Networks
Person Identification Using Multiple Cues

IEEE Transactions on Pattern Analysis and Machine Intelligence
Subject independent facial expression recognition with robust face detection using a convolutional neural network

Neural Networks - 2003 Special issue: Advances in neural networks research — IJCNN'03
Polychronization: Computation with Spikes

Neural Computation
Interaction of Face and Voice Areas during Speaker Recognition

Journal of Cognitive Neuroscience
Robust Object Recognition with Cortex-Like Mechanisms

IEEE Transactions on Pattern Analysis and Machine Intelligence
A tutorial on text-independent speaker verification

EURASIP Journal on Applied Signal Processing
Fast and adaptive network of spiking neurons for multi-view visual pattern recognition

Neurocomputing
Separation and recognition of multiple sound source using pulsed neuron model

ICANN'07 Proceedings of the 17th international conference on Artificial neural networks
Text-independent speaker authentication with spiking neural networks

ICANN'07 Proceedings of the 17th international conference on Artificial neural networks
On-Line learning with structural adaptation in a network of spiking neurons for visual pattern recognition

ICANN'06 Proceedings of the 16th international conference on Artificial Neural Networks - Volume Part I
A review of speech-based bimodal recognition

IEEE Transactions on Multimedia
Adaptive classifier integration for robust pattern recognition

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Neural networks letter: To spike or not to spike: A probabilistic spiking neuron model

Neural Networks
Evolving spiking neural networks and neurogenetic systems for spatio- and spectro-temporal data modelling and pattern recognition

WCCI'12 Proceedings of the 2012 World Congress conference on Advances in Computational Intelligence
A modified one-layer spiking neural network involves derivative of the state function at firing time

ISNN'12 Proceedings of the 9th international conference on Advances in Neural Networks - Volume Part I
A Modified Spiking Neuron that Involves Derivative of the State Function at Firing Time

Neural Processing Letters
NeuCube evospike architecture for spatio-temporal modelling and pattern recognition of brain signals

ANNPR'12 Proceedings of the 5th INNS IAPR TC 3 GIRPR conference on Artificial Neural Networks in Pattern Recognition
Effects of synaptic connectivity on liquid state machine performance

Neural Networks
Evaluating SPAN incremental learning for handwritten digit recognition

ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part III
A spiking neural network based cortex-like mechanism and application to facial expression recognition

Computational Intelligence and Neuroscience
Spike-timing-dependent construction

Neural Computation
NeuCube: A spiking neural network architecture for mapping, learning and understanding of spatio-temporal brain data

Neural Networks
Evolving spiking neural networks for personalised modelling, classification and prediction of spatio-temporal patterns with a case study on stroke

Neurocomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a new modular and integrative sensory information system inspired by the way the brain performs information processing, in particular, pattern recognition. Spiking neural networks are used to model human-like visual and auditory pathways. This bimodal system is trained to perform the specific task of person authentication. The two unimodal systems are individually tuned and trained to recognize faces and speech signals from spoken utterances, respectively. New learning procedures are designed to operate in an online evolvable and adaptive way. Several ways of modelling sensory integration using spiking neural network architectures are suggested and evaluated in computer experiments.