Human observer confidence in image quality assessment

  • Authors:
  • Ulrich Engelke;Anthony Maeder;Hans-JüRgen Zepernick

  • Affiliations:
  • Philips Research Laboratories, 5656 AE Eindhoven, The Netherlands;University of Western Sydney, NSW 1797, Australia;Blekinge Institute of Technology, 371 79 Karlskrona, Sweden

  • Venue:
  • Image Communication
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Mean opinion scores obtained from subjective quality assessment are widely used as a ground truth for the development of predictive quality models. The underlying variance between observer ratings is typically quantified using confidence intervals, which do not provide any direct insight into the underlying causes of the disagreement. For better understanding of human visual quality perception and to develop more accurate models, it is important to identify the factors that impact on the variations in quality ratings. This work considers one such factor: observer confidence. This consideration is motivated by the view that quality assessment is a difficult task and hence quality ratings are provided with varying levels of confidence. The first goal of this paper is to analyse the results of an experiment to determine association between observer confidence and image quality judgement. Secondly, models are developed that aim to predict mean observer confidence as a complementary measure to the widely used mean opinion scores. It is shown that there is indeed a strong interrelation between quality perception and confidence, resulting in predictive models of high accuracy.