WonderTools?: a comparative study of ontological engineering tools
International Journal of Human-Computer Studies
Ontology-Based Photo Annotation
IEEE Intelligent Systems
Audio Structuring and Personalized Retrieval Using Ontologies
ADL '00 Proceedings of the IEEE Advances in Digital Libraries 2000
Automatic video annotation using ontologies extended with visual information
Proceedings of the 13th annual ACM international conference on Multimedia
Enhanced ontologies for video annotation and retrieval
Proceedings of the 7th ACM SIGMM international workshop on Multimedia information retrieval
Multimedia Annotations on the Semantic Web
IEEE MultiMedia
Automatic annotation and semantic retrieval of video sequences using multimedia ontologies
MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Dynamic pictorial ontologies for video digital libraries annotation
Workshop on multimedia information retrieval on The many faces of multimedia semantics
Ontology generation for large email collections
dg.o '08 Proceedings of the 2008 international conference on Digital government research
Proceedings of the 3rd international conference on Mobile multimedia communications
TELE-INFO'05 Proceedings of the 4th WSEAS International Conference on Telecommunications and Informatics
Multimedia enriched ontologies for video digital libraries
International Journal of Parallel, Emergent and Distributed Systems
Video Semantic Content Analysis Framework Based on Ontology Combined MPEG-7
Adaptive Multimedial Retrieval: Retrieval, User, and Semantics
Creating tag hierarchies for effective navigation in social media
Proceedings of the 2008 ACM workshop on Search in social media
Proceedings of the 2009 conference on Law, Ontologies and the Semantic Web: Channelling the Legal Information Flood
Modal keywords, ontologies, and reasoning for video understanding
CIVR'03 Proceedings of the 2nd international conference on Image and video retrieval
Multimedia ontology based computational framework for video annotation and retrieval
MCAM'07 Proceedings of the 2007 international conference on Multimedia content analysis and mining
Navigating within news collections using tag-flakes
Journal of Visual Languages and Computing
An experiment on personal archiving and retrieving image system (PARIS)
ACS'06 Proceedings of the 6th WSEAS international conference on Applied computer science
Domain knowledge extension with pictorially enriched ontologies
CAIP'05 Proceedings of the 11th international conference on Computer Analysis of Images and Patterns
Automatic annotation of images from the practitioner perspective
CIVR'05 Proceedings of the 4th international conference on Image and Video Retrieval
Using knowledge representation languages for video annotation and retrieval
FQAS'06 Proceedings of the 7th international conference on Flexible Query Answering Systems
Hi-index | 0.00 |
In this paper we investigate semi-automatic construction of multimedia ontologies using a data-driven approach. We start with a collection of videos for which we wish to build an ontology (an explicit specification of a domain). Each video is pre-processed: scene cut detection, automatic speech recognition (ASR), and metadata extraction are performed. In addition we automatically index the videos based on visual content by extracting syntactic (e.g., color, texture, etc.) and semantic features (e.g., face, landscape, etc.). We then combine standard tools for ontology engineering and tools in content-based retrieval to semi-automatically build ontologies. In the first stage we process the text information available with the videos (ASR, metadata, and annotations, if any). Stop words (e.g., a, on, the) are eliminated and statistics (e.g., frequency, TFIDF, and entropy) are computed for all terms. Based on this data we manually select concepts and relationships to include in the ontology. Then we use content-based retrieval tools to assign multimedia entities (e.g., shots, videos, collections of videos) to concepts, properties, or relationships in the ontology, and to select multimedia entities as concepts, relationships, or properties in the ontology. We explore this methodology to construct multimedia ontologies from 24 hours of educational films from the 1940s-1960s used in the TREC video retrieval benchmark and discuss the problems encountered and future directions.