The upward bias in measures of information derived from limited data samples
Neural Computation
Spikes: exploring the neural code
Spikes: exploring the neural code
Synergy and redundancy among brain cells of behaving monkeys
Proceedings of the 1998 conference on Advances in neural information processing systems II
Estimation of entropy and mutual information
Neural Computation
Estimating Entropy Rates with Bayesian Confidence Intervals
Neural Computation
Neural Computation
Elements of Information Theory (Wiley Series in Telecommunications and Signal Processing)
Elements of Information Theory (Wiley Series in Telecommunications and Signal Processing)
Information theoretical analysis of multivariate correlation
IBM Journal of Research and Development
A comparison of binless spike train measures
Neural Computing and Applications
Journal of Computational Neuroscience
Transfer entropy--a model-free measure of effective connectivity for the neurosciences
Journal of Computational Neuroscience
Journal of Computational Neuroscience
Information geometry on hierarchy of probability distributions
IEEE Transactions on Information Theory
A universal algorithm for sequential data compression
IEEE Transactions on Information Theory
Hi-index | 0.00 |
Information theory has long been used to quantify interactions between two variables. With the rise of complex systems research, multivariate information measures have been increasingly used to investigate interactions between groups of three or more variables, often with an emphasis on so called synergistic and redundant interactions. While bivariate information measures are commonly agreed upon, the multivariate information measures in use today have been developed by many different groups, and differ in subtle, yet significant ways. Here, we will review these multivariate information measures with special emphasis paid to their relationship to synergy and redundancy, as well as examine the differences between these measures by applying them to several simple model systems. In addition to these systems, we will illustrate the usefulness of the information measures by analyzing neural spiking data from a dissociated culture through early stages of its development. Our aim is that this work will aid other researchers as they seek the best multivariate information measure for their specific research goals and system. Finally, we have made software available online which allows the user to calculate all of the information measures discussedwithin this paper.