An ontology infrastructure for multimedia reasoning

Authors:
Nikolaos Simou;Carsten Saathoff;Stamatia Dasiopoulou;Evangelos Spyrou;Nikola Voisine;Vassilis Tzouvaras;Ioannis Kompatsiaris;Yiannis Avrithis;Steffen Staab
Affiliations:
Image, Video and Multimedia Systems Laboratory, School of Electrical and Computer Engineering, National Technical University of Athens, Zographou Athens, Greece;Informatics and Telematics Institute Centre for Research and Technology Hellas, Thermi-Thessaloniki, Greece;Institute for Computer Science, University of Koblenz, Koblenz, Germany;Image, Video and Multimedia Systems Laboratory, School of Electrical and Computer Engineering, National Technical University of Athens, Zographou Athens, Greece;Institute for Computer Science, University of Koblenz, Koblenz, Germany;Image, Video and Multimedia Systems Laboratory, School of Electrical and Computer Engineering, National Technical University of Athens, Zographou Athens, Greece;Institute for Computer Science, University of Koblenz, Koblenz, Germany;Image, Video and Multimedia Systems Laboratory, School of Electrical and Computer Engineering, National Technical University of Athens, Zographou Athens, Greece;Informatics and Telematics Institute Centre for Research and Technology Hellas, Thermi-Thessaloniki, Greece
Venue:
VLBV'05 Proceedings of the 9th international conference on Visual Content Processing and Representation
Year:
2005

Citing 8
Cited 6

An introduction to genetic algorithms

An introduction to genetic algorithms
Knowledge-Assisted Content-Based Retrieval for Multimedia Databases

IEEE MultiMedia
Semantic Modeling and Knowledge Representation in Multimedia Databases

IEEE Transactions on Knowledge and Data Engineering
Ontology-Based Photo Annotation

IEEE Intelligent Systems
Handbook on Ontologies (International Handbooks on Information Systems)

Handbook on Ontologies (International Handbooks on Information Systems)
Color and texture descriptors

IEEE Transactions on Circuits and Systems for Video Technology
On the data reuse and memory bandwidth analysis for full-search block-matching VLSI architecture

IEEE Transactions on Circuits and Systems for Video Technology
Real-time compressed-domain spatiotemporal segmentation and ontologies for video indexing and retrieval

IEEE Transactions on Circuits and Systems for Video Technology

Dynamic pictorial ontologies for video digital libraries annotation

Workshop on multimedia information retrieval on The many faces of multimedia semantics
Semantic representation of multimedia content: Knowledge representation and semantic indexing

Multimedia Tools and Applications
Learning Rules for Semantic Video Event Annotation

VISUAL '08 Proceedings of the 10th international conference on Visual Information Systems: Web-Based Visual Information Search and Management
Enquiring MPEG-7 based multimedia ontologies

Multimedia Tools and Applications
Semantic annotation of soccer videos by visual instance clustering and spatial/temporal reasoning in ontologies

Multimedia Tools and Applications
Multimedia ontology based computational framework for video annotation and retrieval

MCAM'07 Proceedings of the 2007 international conference on Multimedia content analysis and mining

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, an ontology infrastucture for multimedia reasoning is presented, making it possible to combine low-level visual descriptors with domain specific knowledge and subsequently analyze multimedia content with a generic algorithm that makes use of this knowledge. More specifically, the ontology infrastructure consists of a domain-specific ontology, a visual descriptor ontology (VDO) and an upper ontology. In order to interpret a scene, a set of atom regions is generated by an initial segmentation and their descriptors are extracted. Considering all descriptors in association with the related prototype instances and relations, a genetic algorithm labels the atom regions. Finally, a constraint reasoning engine enables the final region merging and labelling into meaningful objects.