Automatic Annotation of Scientific Video Material based on Visual Concept Detection

  • Authors:
  • Christian Hentschel;Ina Blümel;Harald Sack

  • Affiliations:
  • Hasso Plattner Institute for Software Systems Engineering, Potsdam, Germany;German National Library of Science and Technology, Hannover, Germany;Hasso Plattner Institute for Software Systems Engineering, Potsdam, Germany

  • Venue:
  • Proceedings of the 13th International Conference on Knowledge Management and Knowledge Technologies
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Rapid growth of today's video archives along with sparsely available editorial metadata and too few capacities of libraries and archives for manual annotation demand for efficient approaches of automated metadata extraction. In addition, editorial and non-authoritative metadata is usually not fine-grained enough to describe video on a segment level, which is often required for efficient pinpoint search and retrieval. We consider the use case of the AV Portal provided by the German National Library of Science and Technology -- a web based video search engine that offers access to educational video content from various areas of engineering and natural sciences. User studies that have been conducted during the conceptional design stage of the AV Portal have indicated a strong interest of potential users to search for specific visual concepts, like e.g. "landscape", "drawing", "animation", within videos of a particular domain. We present an approach that supports automatic content-based classification of video segments that is tailored to the special requirements of the AV Portal regarding its technology oriented content and academic users. We furthermore show that semantic analysis of the generated metadata not only allows for better retrieval goal definition but also offers explorative search within the archive using visual concepts.