Subjective Multimedia Quality Assessment

  • Authors:

  • Matthew D. Brotherton;Quan Huynh-Thu;David S. Hands;Kjell BrunnstrÖm

  • Affiliations:

  • The authors are with Perceptual Engineering Group, Broadband Applications Research Centre, British Telecom, UK. E-mail: david.2.hands@bt.com,;The author is with Psytechnics Ltd., UK and also with University of Essex, UK.,;The authors are with Perceptual Engineering Group, Broadband Applications Research Centre, British Telecom, UK. E-mail: david.2.hands@bt.com,;The author is with the Acreo AB, Stockholm, Sweden.

  • Venue:
  • IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

The Video Quality Experts Group (VQEG) is preparing a programme of subjective multimedia quality tests. The results from these tests will be used to evaluate the performance of competing objective multimedia quality metrics. The reliability of the subjective test data is of great importance for VQEG's task. This paper provides an overview of VQEG's multimedia ad-hoc group. The work of this group will require subjective tests to be performed by laboratories located in Europe, Asia and North America. For VQEG's multimedia work to be successful, the subjective assessment methodology must be precisely defined and produce reliable and repeatable subjective quality data. Although international standards covering multimedia quality assessment methods are in force, there remains some uncertainty regarding the most effective approach to assessing the subjective quality of multimedia. A review of existing methods is provided. Two experiments are presented investigating the suitability of alternative subjective assessment methods (single-stimulus ACR and SAMVIQ). The results of these experiments are discussed within the context of the VQEG multimedia testing programme.