2010 Special Issue: Classification of 2-dimensional array patterns: Assembling many small neural networks is better than using a large one

Authors:
Liang Chen;Wei Xue;Naoyuki Tokuda
Affiliations:
Computer Science Department, University of Northern British Columbia, Prince George, B.C., Canada V2N 4Z9;Wenzhou University, Wenzhou City, Zhejiang Province, China;SunFlare R & D Center, Shinjuku Hirose Bldg, Yotsuya 4-7, Shinjuku-ku, Tokyo 160-0004, Japan
Venue:
Neural Networks
Year:
2010

Citing 15
Cited 1

On Combining Classifiers

IEEE Transactions on Pattern Analysis and Machine Intelligence
The Random Subspace Method for Constructing Decision Forests

IEEE Transactions on Pattern Analysis and Machine Intelligence
Neural Networks: A Comprehensive Foundation

Neural Networks: A Comprehensive Foundation
A two-level Hamming network for high performance associative memory

Neural Networks
Ensembling neural networks: many could be better than all

Artificial Intelligence
Stability Analysis of Regional and National Voting Schemes by a Continuous Model

IEEE Transactions on Knowledge and Data Engineering
Convolutional Face Finder: A Neural Architecture for Fast and Robust Face Detection

IEEE Transactions on Pattern Analysis and Machine Intelligence
Eigenfaces for recognition

Journal of Cognitive Neuroscience
Evaluation of Gender Classification Methods with Automatically Detected and Aligned Faces

IEEE Transactions on Pattern Analysis and Machine Intelligence
A general stability analysis on regional and national voting schemes against noise---why is an electoral college more stable than a direct popular election?

Artificial Intelligence
A recurrent neural fuzzy network for word boundary detection invariable noise-level environments

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
A recurrent self-organizing neural fuzzy inference network

IEEE Transactions on Neural Networks
Task decomposition and module combination based on class relations: a modular neural network for pattern classification

IEEE Transactions on Neural Networks
A robust approach to independent component analysis of signals with high-level noise measurements

IEEE Transactions on Neural Networks
Recognizing partially occluded, expression variant faces from single training image per person with SOM and soft k-NN ensemble

IEEE Transactions on Neural Networks

The build of n-Bits Binary Coding ICBP Ensemble System

Neurocomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

In many pattern classification/recognition applications of artificial neural networks, an object to be classified is represented by a fixed sized 2-dimensional array of uniform type, which corresponds to the cells of a 2-dimensional grid of the same size. A general neural network structure, called an undistricted neural network, which takes all the elements in the array as inputs could be used for problems such as these. However, a districted neural network can be used to reduce the training complexity. A districted neural network usually consists of two levels of sub-neural networks. Each of the lower level neural networks, called a regional sub-neural network, takes the elements in a region of the array as its inputs and is expected to output a temporary class label, called an individual opinion, based on the partial information of the entire array. The higher level neural network, called an assembling sub-neural network, uses the outputs (opinions) of regional sub-neural networks as inputs, and by consensus derives the label decision for the object. Each of the sub-neural networks can be trained separately and thus the training is less expensive. The regional sub-neural networks can be trained and performed in parallel and independently, therefore a high speed can be achieved. We prove theoretically in this paper, using a simple model, that a districted neural network is actually more stable than an undistricted neural network in noisy environments. We conjecture that the result is valid for all neural networks. This theory is verified by experiments involving gender classification and human face recognition. We conclude that a districted neural network is highly recommended for neural network applications in recognition or classification of 2-dimensional array patterns in highly noisy environments.