Finding the game flow from sports video

  • Authors:
  • Yi Ding;Guoliang Fan

  • Affiliations:
  • Oklahoma State University, Stillwater, OK, USA;Oklahoma State University, Stillwater, OK, USA

  • Venue:
  • J-MRE '11 Proceedings of the 2011 joint ACM workshop on Modeling and representing events
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a new paradigm of for sports video mining where the game flow is used to represent the semantic evolution of a field sports game. A game flow is composed of a series of variable-length drives that summarize the whole game by a few labeled events, and each drive includes a set of consecutive plays each of which is annotated by some mid-level keywords. This paradigm delivers a multi-level semantic video understanding framework that not only supports the detection of events-of-interest but also summarizes the overall semantic evolution. Specifically, we develop an Auxiliary Segmentation Conditional Random Fields (ASCRF) to explore the game flow from broadcasting sports video sequences. Not only can the proposed ASCRF support joint segmentation and recognition of drives from a set of plays annotated by multi-channel keywords, but also is capable of dealing with the problem of missing keywords by introducing an auxiliary layer by which some useful contextual information can be learned to compensate for the possible missing keywords. The experimental results on a set of American football videos demonstrates the advantages of ASCRF for finding the game flow from a set of annotated plays and its potential for other video mining applications.