Domain knowledge extension with pictorially enriched ontologies

Authors:
M. Bertini;R. Cucchiara;A. Del Bimbo;C. Torniai
Affiliations:
D.S.I. – Università di Firenze, Italy;D.I.I. – Università di Modena e Reggio Emilia, Italy;D.S.I. – Università di Firenze, Italy;D.S.I. – Università di Firenze, Italy
Venue:
CAIP'05 Proceedings of the 11th international conference on Computer Analysis of Images and Patterns
Year:
2005

Citing 8
Cited 0

Pattern Recognition with Fuzzy Objective Function Algorithms

Pattern Recognition with Fuzzy Objective Function Algorithms
Semantic Indexing of Multimedia Documents

IEEE MultiMedia
Trajectory-based ball detection and tracking with applications to semantic analysis of broadcast soccer video

MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
Semantic annotation of soccer videos: automatic highlights identification

Computer Vision and Image Understanding - Special isssue on video retrieval and summarization
Semi-automatic, data-driven construction of multimedia ontologies

ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 2
Modal keywords, ontologies, and reasoning for video understanding

CIVR'03 Proceedings of the 2nd international conference on Image and video retrieval
Automatic soccer video analysis and summarization

IEEE Transactions on Image Processing
Real-time compressed-domain spatiotemporal segmentation and ontologies for video indexing and retrieval

IEEE Transactions on Circuits and Systems for Video Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

Classifying video elements according to some pre-defined ontology of the video content is the typical way to perform video annotation. Ontologies are built by defining relationship between linguistic terms that describe domain concepts at different abstraction levels. Linguistic terms are appropriate to distinguish specific events and object categories but they are inadequate when they must describe video entities or specific patterns of events. In these cases visual prototypes can better express pattern specifications and the diversity of visual events. To support video annotation up to the level of pattern specification enriched ontologies, that include visual concepts together with linguistic keywords, are needed. This paper presents Pictorially Enriched ontologies and provides a solution for their implementation in the soccer video domain. The pictorially enriched ontology created is used both to directly assign multimedia objects to concepts, providing a more meaningful definition than the linguistics terms, and to extend the initial knowledge of the domain, adding subclasses of highlights or new highlight classes that were not defined in the linguistic ontology. Automatic annotation of soccer clips up to the pattern specification level using a pictorially enriched ontology is discussed.