Detecting Events from Continuous Media by Intermodal Collaboration and Knowledge Use

  • Authors:
  • Noboru Babaguchi;Shigekazu Sasamori;Tadahiro Kitahashi;Ramesh Jain

  • Affiliations:
  • Osaka University;Osaka University;Osaka University;University of California at San Diego

  • Venue:
  • ICMCS '99 Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2
  • Year:
  • 1999

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we propose an event network, which is a structured representation oriented for the contents of continuous media, as well as present two methods of detecting events as the first step to construct the network. We here deal with sports TV programs, considering American football as a case study. The first method is simple intermodal collaboration: linking between visual and linguistic (closed caption) streams. Using domain knowledge about state transitions of football games, the second method attempts to extract specific visual objects including the information about contents. The experimental results indicate that the both methods are effective for event detection.