Pattern Recognition with Fuzzy Objective Function Algorithms
Pattern Recognition with Fuzzy Objective Function Algorithms
Semantic Indexing of Multimedia Documents
IEEE MultiMedia
Semantic Annotation of Sports Videos
IEEE MultiMedia
MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
Semantic annotation of soccer videos: automatic highlights identification
Computer Vision and Image Understanding - Special isssue on video retrieval and summarization
Semi-automatic, data-driven construction of multimedia ontologies
ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 2
Modal keywords, ontologies, and reasoning for video understanding
CIVR'03 Proceedings of the 2nd international conference on Image and video retrieval
Automatic soccer video analysis and summarization
IEEE Transactions on Image Processing
IEEE Transactions on Circuits and Systems for Video Technology
Knowledge-assisted semantic video object detection
IEEE Transactions on Circuits and Systems for Video Technology
Automatic annotation and semantic retrieval of video sequences using multimedia ontologies
MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Video Semantic Content Analysis Framework Based on Ontology Combined MPEG-7
Adaptive Multimedial Retrieval: Retrieval, User, and Semantics
Characterizing Multimedia Objects through Multimodal Content Analysis and Fuzzy Fingerprints
Advanced Internet Based Systems and Applications
Semantic representation of multimedia content
Knowledge-driven multimedia information extraction and ontology evolution
Using knowledge representation languages for video annotation and retrieval
FQAS'06 Proceedings of the 7th international conference on Flexible Query Answering Systems
Hi-index | 0.00 |
A typical way to perform video annotation requires to classify video elements (e.g. events and objects) according to some pre-defined ontology of the video content domain. Ontologies are defined by establishing relationships between linguistic terms that specify domain concepts at different abstraction levels. However, although linguistic terms are appropriate to distinguish event and object categories, they are inadequate when they must describe specific or complex patterns of events or video entities. Instead, in these cases, pattern specifications can be better expressed using visual prototypes, either images or video clips, that capture the essence of the event or entity. Therefore enhanced ontologies, that include both visual and linguistic concepts, can be useful to support video annotation up to the level of detail of pattern specification.This paper presents algorithms and techniques that employ enriched ontologies for video annotation and retrieval, and discusses a solution for their implementation for the soccer video domain. An unsupervised clustering method is proposed in order to create pictorially enriched ontologies by defining visual prototypes that represent specific patterns of highlights and adding them as visual concepts to the ontology.Two algorithms that use pictorially enriched ontologies to perform automatic soccer video annotation are proposed and results for typical highlights are presented. Annotation is performed associating occurrences of events, or entities, to higher level concepts by checking their similarity to visual concepts that are hierarchically linked to higher level semantics, using a dynamic programming approach.Usage of reasoning on the ontology is shown, to perform higher-level annotation of the clips using the domain knowledge and to create complex queries that comprise visual prototypes of actions, their temporal evolution and relations.