Analyzing Voice-over-IP Subjective Quality as a Function of Network QoS: A Simulation-Based Methodology and Tool

  • Authors:
  • Adrian E. Conway;Yali Zhu

  • Affiliations:
  • -;-

  • Venue:
  • TOOLS '02 Proceedings of the 12th International Conference on Computer Performance Evaluation, Modelling Techniques and Tools
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

A simulation-based methodology is developed for analyzing the subjective quality of voice-over-IP calls as a function of network QoS parameters and choices in implementation and configuration. The proposed method combines the use of existing objective voice-quality measurement algorithms, such as the ITU-T P.861 PSQM, and artificial voice reference signals, such as the ITU-T P.50, with the discrete-event simulation of a network QoS model. A significant advantage of the method is that it does not involve the use of human subjects in evaluating subjective voice quality levels. This enables one to entirely automate the process of quantifying call quality as a function of network QoS and implementation choices such as packet size and codec type. Such automation enables one to realize significant time and cost savings in obtaining experimental results. A tool implementation is described that includes basic network packet loss and delay jitter models. Example numerical results are presented for the G.711 codec. The extension of the method to the subjective quality evaluation of audio, video, and multimedia signals is also described. The paper also introduces the concepts of 'subjective teletraffic engineering' and 'subjective equivalent bandwidths.'