Large scale content analysis engine

  • Authors:
  • David Gibbon;Zhu Liu

  • Affiliations:
  • AT&T Labs - Research, Middletown, NJ, USA;AT&T Labs - Research, Middletown, NJ, USA

  • Venue:
  • LS-MMRM '09 Proceedings of the First ACM workshop on Large-scale multimedia retrieval and mining
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

The evolution of IP video systems has resulted in unprecedented access to a wide range of video material for consumers via IPTV and Web delivery. Retrieval technologies help users find relevant content, but suffer from a paucity of reliable content descriptions. In this paper, we describe the large scale content analysis engine (CAE) which is designed to facilitate content based video retrieval, as well as a number of other applications such as content repurposing, video browsing, discovering content relationships, and fine-grained content personalization. A scalable system is presented to handle video from broadcast, enterprise and web sources for applications including IPTV and mobile video. Media processing includes shot boundary detection, automatic speech recognition, face detection, clustering of shots and faces, speaker segmentation, closed caption alignment, concept detection, and transcoding. Metadata ingest, augmentation and delivery using a standards-based approach enable the CAE to serve a range of content processing applications.