Self-enhancement learning: self-supervised and target-creating learning

Authors:
Ryotaro Kamimura
Affiliations:
IT Education Center, Tokai University, Japan
Venue:
IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Year:
2009

Citing 16
Cited 1

Self-Organization in a Perceptual Network

Computer
Self-organization and associative memory: 3rd edition

Self-organization and associative memory: 3rd edition
Competitive learning algorithms for vector quantization

Neural Networks
The formation of topographic maps that maximize the average mutual information of the output responses to noiseless input signals

Neural Computation
Self-organizing maps

Self-organizing maps
Faithful representations with topographic maps

Neural Networks
Neural Networks for Pattern Recognition

Neural Networks for Pattern Recognition
Feature extraction by non parametric mutual information maximization

The Journal of Machine Learning Research
Lower and Upper Bounds for Misclassification Probability Based on Renyi's Information

Journal of VLSI Signal Processing Systems
Improved local learning rule for information maximization and related applications

Neural Networks
Local synaptic learning rules suffice to maximize mutual information in a linear network

Neural Computation
How to generate ordered maps by maximizing the mutual information between input and output signals

Neural Computation
Free energy-based competitive learning for self-organizing maps

AIA '08 Proceedings of the 26th IASTED International Conference on Artificial Intelligence and Applications
Topographic map formation by maximizing unconditional entropy: a plausible strategy for “online” unsupervised competitive learning and nonparametric density estimation

IEEE Transactions on Neural Networks
Self-organizing maps, vector quantization, and mixture modeling

IEEE Transactions on Neural Networks
Cooperative information maximization with Gaussian activation functions for self-organizing maps

IEEE Transactions on Neural Networks

Double enhancement learning for explicit internal representations: unifying self-enhancement and information enhancement to incorporate information on input variables

Applied Intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we propose a new learning method called "self-enhancement learning." In this model, a network enhances its state by itself, and this enhanced state is to be imitated by another state of the network. The word "target" in our model means that a target is created spontaneously by a network, which must try to attain the target. Enhancement is realized by changing the Gaussian width or enhancement parameter. With different enhancement parameters, we can set up the different states of a network. In particular, we set up an enhanced and a relaxed state, and the relaxed state tries to imitate the enhanced state as much as possible. To demonstrate the effectiveness of this method, we apply the self-enhancement learning to the SOMe For this purpose, we introduce collectiveness into an enhanced state in which all neurons collectively respond to input patterns. Then, this enhanced and collective state should be imitated by the other non-enhanced and relaxed state. We applied the method to the Iris problem. Experimental results showed that the V-matrices obtained were significantly similar to those produced by the conventional SOMe However, much better performance could be obtained in terms of quantitative and topological errors. The experimental results suggest the possibility for the self-enhancement learning to be applied to many different neural network models.