A mutual information extension to the matched filter
Signal Processing - Special issue: Information theoretic signal processing
Minimum-entropy estimation in semi-parametric models
Signal Processing - Special issue: Information theoretic signal processing
Fast kernel entropy estimation and optimization
Signal Processing - Special issue: Information theoretic signal processing
Some Equivalences between Kernel Methods and Information Theoretic Methods
Journal of VLSI Signal Processing Systems
Error Entropy in Classification Problems: A Univariate Data Analysis
Neural Computation
Entropy based robust estimator and its application to line-based mapping
Robotics and Autonomous Systems
Sensor Fusion for SLAM Based on Information Theory
Journal of Intelligent and Robotic Systems
Information theoretic learning with adaptive kernels
Signal Processing
Mean-square convergence analysis of ADALINE training with minimum error entropy criterion
IEEE Transactions on Neural Networks
The mee principle in data classification: A perceptron-based analysis
Neural Computation
WSEAS TRANSACTIONS on COMMUNICATIONS
International Journal of Systems, Control and Communications
An Entropy Optimization Strategy for Simultaneous Localization and Mapping
Journal of Intelligent and Robotic Systems
Neural networks trained with the EEM algorithm: tuning the smoothing parameter
NN'05 Proceedings of the 6th WSEAS international conference on Neural networks
Batch-sequential algorithm for neural networks trained with entropic criteria
ICANN'05 Proceedings of the 15th international conference on Artificial neural networks: formal models and their applications - Volume Part II
Single layer complex valued neural network with entropic cost function
ICANN'11 Proceedings of the 21th international conference on Artificial neural networks - Volume Part I
Neural network classification: maximizing zero-error density
ICAPR'05 Proceedings of the Third international conference on Advances in Pattern Recognition - Volume Part I
Minimum entropy control for stochastic systems based on the wavelet neural networks
ISNN'06 Proceedings of the Third international conference on Advnaces in Neural Networks - Volume Part II
Estimating the information potential with the fast gauss transform
ICA'06 Proceedings of the 6th international conference on Independent Component Analysis and Blind Signal Separation
Error entropy minimization for LSTM training
ICANN'06 Proceedings of the 16th international conference on Artificial Neural Networks - Volume Part I
An entropy approach to filtering for networked control systems
International Journal of Computer Applications in Technology
Learning theory approach to minimum error entropy criterion
The Journal of Machine Learning Research
Kernel minimum error entropy algorithm
Neurocomputing
| Hi-index | 35.68 |
The paper investigates error-entropy-minimization in adaptive systems training. We prove the equivalence between minimization of error's Renyi (1970) entropy of order α and minimization of a Csiszar (1981) distance measure between the densities of desired and system outputs. A nonparametric estimator for Renyi's entropy is presented, and it is shown that the global minimum of this estimator is the same as the actual entropy. The performance of the error-entropy-minimization criterion is compared with mean-square-error-minimization in the short-term prediction of a chaotic time series and in nonlinear system identification