Improving the Accuracy of Automatic Tennis Video Annotation by High Level Grammar

  • Authors:
  • W. J. Christmas;I. Kolonias;J. Kittler;F. Yan

  • Affiliations:
  • -;-;-;-

  • Venue:
  • ICIAPW '07 Proceedings of the 14th International Conference of Image Analysis and Processing - Workshops
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Automatic interpretation of videos in general and sports videos in particular relies heavily on the use of contextual information. The contextual information is encapsulated in form of grammars capturing the permissible relationships between the static and dynamic objects of the video con- tent. The grammar is invariably multilevel, characterising the spatiotemporal relationships of pixels at the lowest level of analysis, and governing the interaction of objects and the evolution of concepts at the highest level of abstraction. An automatic video analysis system has been developed that applies multilevel contextual reasoning to understand and annotate tennis video. The system that exploits grammat- ical rules up to the point level achieves an impressive ac- curacy of 87.5%. We demonstrate that by adding an extra level in the contextual hierarchy which imposes constraints on the evolution of tennis video at the game level, further performance improvements can be gained.