Early experiments with neural diversity machines

Authors:
Tomas Maul
Affiliations:
University of Nottingham Malaysia Campus, School of Computer Science, Jalan Broga, Selangor Darul Ehsan, 43500 Semenyih, Malaysia
Venue:
Neurocomputing
Year:
2013

Citing 14
Cited 0

Multilayer feedforward networks are universal approximators

Neural Networks
Support-Vector Networks

Machine Learning
Genetic Algorithms in Search, Optimization and Machine Learning

Genetic Algorithms in Search, Optimization and Machine Learning
Differential Evolution – A Simple and Efficient Heuristic for Global Optimization over Continuous Spaces

Journal of Global Optimization
Theoretical Views of Boosting and Applications

ALT '99 Proceedings of the 10th International Conference on Algorithmic Learning Theory
A fast learning algorithm for deep belief nets

Neural Computation
Combined projection and kernel basis functions for classification in evolutionary neural networks

Neurocomputing
2009 Special Issue: A new learning paradigm: Learning using privileged information

Neural Networks
Learning Deep Architectures for AI

Foundations and Trends® in Machine Learning
Unsupervised learning in second-order neural networks for motion analysis

Neurocomputing
Hybrid artificial neural networks: models, algorithms and data

IWANN'11 Proceedings of the 11th international conference on Artificial neural networks conference on Advances in computational intelligence - Volume Part II
Tuning of the structure and parameters of a neural network using an improved genetic algorithm

IEEE Transactions on Neural Networks
Genetic evolution of the topology and weight distribution of neural networks

IEEE Transactions on Neural Networks
Cybernetics of Vision Systems: Toward an Understanding of Putative Functions of the Outer Retina

IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans

Quantified Score

Hi-index	0.01

Visualization

Abstract

The current paper introduces the concept of neural diversity machines (NDM) which, refers to hybrid artificial neural networks (HANN) with conditions on the minimum number of functions available to the network, amongst several other properties. The paper demonstrates how NDM networks can be optimized for solving different problems. The results demonstrate the feasibility of the approach and bolster some of the biological and computational arguments in favor of neural diversity. A substantial number of optimization experiments were conducted, generating a corresponding number of diverse neural architectures, which revealed several unexpected statistics, including the relative commonality of nodes combining inner-product and Gaussian functions. The paper confirms the advantages of HANN, demonstrates the potential of increasing the focus on neural diversity and hints at possible new neural computational strategies.