Framework for measurement of the intensity of motion activity of video segments

  • Authors:
  • Kadir A. Peker;Ajay Divakaran

  • Affiliations:
  • Mitsubishi Electric Research Laboratories, 201 Broadway, Cambridge, MA 02139, USA;Mitsubishi Electric Research Laboratories, 201 Broadway, Cambridge, MA 02139, USA

  • Venue:
  • Journal of Visual Communication and Image Representation
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a psychophysical and analytical framework for comparing the performance of motion activity measures for video segments, with respect to a subjective ground truth. We first obtain a ground truth for the motion activity by conducting a psychophysical experiment. Then we present several low-complexity motion activity descriptors computed from compressed domain block motion vectors. In the first analysis, we quantize the descriptors and show that they perform well against the ground truth. The MPEG-7 motion activity descriptor is also among the best performers. In the second analysis, we examine the specific cases where each descriptor fails, using a novel pair-wise comparison method. The analytical measures overestimate or underestimate the intensity of motion activity under strong camera motion or extreme camera angles. We finally discuss the experimental methodology and analysis methods we used, and possible alternatives. We review the applications of motion activity and how our results relate to them.