The Cramér-Rao bound for estimating a sparse parameter vector

  • Authors:
  • Zvika Ben-Haim;Yonina C. Eldar

  • Affiliations:
  • Department of Electrical Engineering, Technion-Israel Institute of Technology, Haifa, Israel;Department of Electrical Engineering, Technion-Israel Institute of Technology, Haifa, Israel

  • Venue:
  • IEEE Transactions on Signal Processing
  • Year:
  • 2010

Quantified Score

Hi-index 35.69

Visualization

Abstract

The goal of this contribution is to characterize the best achievable mean-squared error (MSE) in estimating a sparse deterministic parameter from measurements corrupted by Gaussian noise. To this end, an appropriate definition of bias in the sparse setting is developed, and the constrained Cramér-Rao bound (CRB) is obtained. This bound is shown to equal the CRB of an estimator with knowledge of the support set, for almost all feasible parameter values. Consequently, in the unbiased case, our bound is identical to the MSE of the oracle estimator. Combined with the fact that the CRB is achieved at high signal-to-noise ratios signal-to-noise ratio (SNRs) by the maximum likelihood technique, our result provides a new interpretation for the common practice of using the oracle estimator as a gold standard against which practical approaches are compared.