Reduced-dimension linear transform coding of distributed correlated signals with incomplete observations

  • Authors:
  • Hendra I. Nurdin;Ravi R. Mazumdar;Arunabha Bagchi

  • Affiliations:
  • Department of Information Engineering, College of Engineering and Computer Science, The Australian National University, Canberra, ACT, Australia;Department of Electrical and Computer Engineering, University of Waterloo, Waterloo, ON, Canada;Systems, Signals and Control group, Department of Applied Mathematics, University of Twente, Enschede, The Netherlands

  • Venue:
  • IEEE Transactions on Information Theory
  • Year:
  • 2009

Quantified Score

Hi-index 754.84

Visualization

Abstract

We study the problem of optimal reduced-dimension linear transform coding and reconstruction of a signal based on distributed correlated observations of the signal. In the mean square estimation context this involves finding the optimal signal representation based on multiple incomplete or only partial observations that are correlated. In particular, this leads to the study of finding the optimal Karhunen-Loève basis based on the censored observations. The problem has been considered previously by Gastpar, Dragotti, and Vetterli in the context of jointly Gaussian random variables based on using conditional covariances. In this paper, we derive the estimation results in the more general setting of second-order random variables with arbitrary distributions, using entirely different techniques based on the idea of innovations. We explicitly solve the single transform coder case, give a characterization of optimality in the multiple distributed transform coders scenario and provide additional insights into the structure of the problem.