Determination of categories for tagging and automated classification of film scenes

  • Authors:
  • Cornelia Lanz;Stefanie Nowak;Uwe Kühhirt

  • Affiliations:
  • Fraunhofer IDMT, Ilmenau, Germany;Fraunhofer IDMT, Ilmenau, Germany;Fraunhofer IDMT, Ilmenau, Germany

  • Venue:
  • Proceedings of the 8th international interactive conference on Interactive TV&Video
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Tags are a useful tool for film search and recommendation because they contain valuable information in a compressed form. However, manual tagging is time-consuming and needs the involvement of many people. We are working on automated cross-modal video classification algorithms based on signal processing. These algorithms assign subcategories to film scenes. The subcategories are useful to cluster scenes in different groups and therefore can also be used as tags. In this paper, we point out the advantages of tags generated by automated video classification and present the determination of five possible categories with their associated subcategories. The determination was obtained with five group studies to ensure that the categories fit the way humans classify. Because they are based on the audiovisual content and do not include additional external information like name of director or year of production, they are suited for automated classification as well. The final categories are called Dynamic, Valence, Interaction, Suspense and Essential Features. They contain between two and nine subcategories.