Estimating the entropy of a signal with applications

Authors:
J.-F. Bercher;C. Vignat
Affiliations:
Lab. Signaux et Telecoms, ESIEE, Noisy-le-Grand;-
Venue:
IEEE Transactions on Signal Processing
Year:
2000

Citing 0
Cited 7

ICA using spacings estimates of entropy

The Journal of Machine Learning Research
ICA using spacings estimates of entropy

The Journal of Machine Learning Research
The entropy of a constrained signal: A maximum entropy approach with applications

Signal Processing
Entropy-based spectrum sensing in cognitive radio

Signal Processing
Fast communication: A simple method to quantify the morphological similarity between signals

Signal Processing
Coding Images with Local Features

International Journal of Computer Vision
A Novel Two-Stage Entropy-Based Robust Cooperative Spectrum Sensing Scheme with Two-Bit Decision in Cognitive Radio

Wireless Personal Communications: An International Journal

Quantified Score

Hi-index	35.68

Visualization

Abstract

We present a new estimator of the entropy of continuous signals. We model the unknown probability density of data in the form of an AR spectrum density and use regularized long-AR models to identify the AR parameters. We then derive both an analytical expression and a practical procedure for estimating the entropy from sample data. We indicate how to incorporate recursive and adaptive features in the procedure. We evaluate and compare the new estimator with other estimators based on histograms, kernel density models, and order statistics. Finally, we give several examples of applications. An adaptive version of our entropy estimator is applied to detection of law changes, blind deconvolution, and source separation