Dynamic pictorial ontologies for video digital libraries annotation

  • Authors:
  • Marco Bertini;Alberto Del Bimbo;Carlo Torniai;Costantino Grana;Rita Cucchiara

  • Affiliations:
  • Università di Firenze, Firenze, Italy;Università di Firenze, Firenze, Italy;Università di Firenze, Firenze, Italy;Università di Modena e Reggio Emilia, Modena, Italy;Università di Modena e Reggio Emilia, Modena, Italy

  • Venue:
  • Workshop on multimedia information retrieval on The many faces of multimedia semantics
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we present the dynamic pictorial ontology paradigm for video annotation. Ontologies are often used to describe a given domain for different goals, including description of multimedia data. In the case of video annotation, the visual knowledge cannot be described using only abstract concepts but is more effectively represented in a visual form. To this aim, we introduce visual concepts, elicited from the data set as the most representative prototypes that specialize abstract concepts. The ontology created is intrinsically dynamic since it must embrace the perceptual and visual experience during annotation. Thus visual concepts can change, adapting to the multimedia content analyzed. Motivation for this new ontology paradigm are discussed together with a proposal of a framework for ontology creation, maintenance, and automatic annotation of video. The creation and usage of dynamic pictorial ontologies have been tested for soccer domain exploiting low level perceptual features and higher level domain features.