What does the retina know about natural scenes?
Neural Computation
Understanding retinal color coding from first principles
Neural Computation
A measure of total variability for the multivariate t distribution with applications to finance
Information Sciences: an International Journal
Shunting inhibition does not have a divisive effect on firing rates
Neural Computation
The multiinformation function as a tool for measuring stachastic dependence
Learning in graphical models
On maximum entropy characterization of Pearson's type II and VII multivariate distributions
Journal of Multivariate Analysis
Videoconferencing 2000: H.323's year?
Network Computing
Estimation of entropy and mutual information
Neural Computation
The steerable pyramid: a flexible architecture for multi-scale derivative computation
ICIP '95 Proceedings of the 1995 International Conference on Image Processing (Vol. 3)-Volume 3 - Volume 3
Embedded wavelet image compression based on a joint probability model
ICIP '97 Proceedings of the 1997 International Conference on Image Processing (ICIP '97) 3-Volume Set-Volume 1 - Volume 1
Fields of Experts: A Framework for Learning Image Priors
CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Elements of Information Theory (Wiley Series in Telecommunications and Signal Processing)
Elements of Information Theory (Wiley Series in Telecommunications and Signal Processing)
Modeling Multiscale Subbands of Photographic Images with Fields of Gaussian Scale Mixtures
IEEE Transactions on Pattern Analysis and Machine Intelligence
Information theoretical analysis of multivariate correlation
IBM Journal of Research and Development
Nonlinear image representation for efficient perceptual coding
IEEE Transactions on Image Processing
Hi-index | 0.00 |
Efficient coding transforms that reduce or remove statistical dependencies in natural sensory signals are important for both biology and engineering. In recent years, divisive normalization (DN) has been advocated as a simple and effective nonlinear efficient coding transform. In this work, we first elaborate on the theoretical justification for DN as an efficient coding transform. Specifically, we use the multivariate t model to represent several important statistical properties of natural sensory signals and show that DN approximates the optimal transforms that eliminate statistical dependencies in the multivariate t model. Second, we show that several forms of DN used in the literature are equivalent in their effects as efficient coding transforms. Third, we provide a quantitative evaluation of the overall dependency reduction performance of DN for both the multivariate t models and natural sensory signals. Finally, we find that statistical dependencies in the multivariate t model and natural sensory signals are increased by the DN transform with low-input dimensions. This implies that for DN to be an effective efficient coding transform, it has to pool over a sufficiently large number of inputs.