Estimation of Mutual Information: A Survey

Authors:
Janett Walters-Williams;Yan Li
Affiliations:
School of Computing and Information Technology, University of Technology, Jamaica, Jamaica W.I. and Department of Mathematics and Computing, Centre for Systems Biology, University of Southern Quee ...;Department of Mathematics and Computing, Centre for Systems Biology, University of Southern Queensland, Australia 4350
Venue:
RSKT '09 Proceedings of the 4th International Conference on Rough Sets and Knowledge Technology
Year:
2009

Citing 0
Cited 3

Model sparsity and brain pattern interpretation of classification models in neuroimaging

Pattern Recognition
Nearest neighbor estimate of conditional mutual information in feature selection

Expert Systems with Applications: An International Journal
Objective Intelligibility Measures Based on Mutual Information for Speech Subjected to Speech Enhancement Processing

IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP)

Quantified Score

Hi-index	0.00

Visualization

Abstract

A common problem found in statistics, signal processing, data analysis and image processing research is the estimation of mutual information, which tends to be difficult. The aim of this survey is threefold: an introduction for those new to the field, an overview for those working in the field and a reference for those searching for literature on different estimation methods. In this paper comparison studies on mutual information estimation is considered. The paper starts with a description of entropy and mutual information and it closes with a discussion on the performance of different estimation methods and some future challenges.