Dynamic pictorial ontologies for video digital libraries annotation
Workshop on multimedia information retrieval on The many faces of multimedia semantics
Exploiting redundancy in cross-channel video retrieval
Proceedings of the international workshop on Workshop on multimedia information retrieval
The importance of query-concept-mapping for automatic video retrieval
Proceedings of the 15th international conference on Multimedia
Ontology-enriched semantic space for video search
Proceedings of the 15th international conference on Multimedia
Investigating keyframe selection methods in the novel domain of passively captured visual lifelogs
CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
Measuring the impact of temporal context on video retrieval
CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
Web-based information content and its application to concept-based video retrieval
CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
Learning Rules for Semantic Video Event Annotation
VISUAL '08 Proceedings of the 10th international conference on Visual Information Systems: Web-Based Visual Information Search and Management
Fusing semantics, observability, reliability and diversity of concept detectors for video search
MM '08 Proceedings of the 16th ACM international conference on Multimedia
Boosting image retrieval through aggregating search results based on visual annotations
MM '08 Proceedings of the 16th ACM international conference on Multimedia
Assessing concept selection for video retrieval
MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
Learning ontology rules for semantic video annotation
MS '08 Proceedings of the 2nd ACM workshop on Multimedia semantics
Enriching a Thesaurus to Improve Retrieval of Audiovisual Documents
SAMT '08 Proceedings of the 3rd International Conference on Semantic and Digital Media Technologies: Semantic Multimedia
Integrating Image Segmentation and Classification for Fuzzy Knowledge-Based Multimedia Indexing
MMM '09 Proceedings of the 15th International Multimedia Modeling Conference on Advances in Multimedia Modeling
Query representation by structured concept threads with application to interactive video retrieval
Journal of Visual Communication and Image Representation
Proceedings of the 18th international conference on World wide web
Foundations and Trends in Information Retrieval
Image categorization combining neighborhood methods and boosting
LS-MMRM '09 Proceedings of the First ACM workshop on Large-scale multimedia retrieval and mining
Large scale content analysis engine
LS-MMRM '09 Proceedings of the First ACM workshop on Large-scale multimedia retrieval and mining
Semantic context transfer across heterogeneous sources for domain adaptive video search
MM '09 Proceedings of the 17th ACM international conference on Multimedia
Learning social tag relevance by neighbor voting
IEEE Transactions on Multimedia
Multimedia Tools and Applications
Multimedia ontology based computational framework for video annotation and retrieval
MCAM'07 Proceedings of the 2007 international conference on Multimedia content analysis and mining
Content-based story segmentation of news video by multimodal analysis
FSKD'09 Proceedings of the 6th international conference on Fuzzy systems and knowledge discovery - Volume 7
Utilizing related samples to learn complex queries in interactive concept-based video search
Proceedings of the ACM International Conference on Image and Video Retrieval
Investigating fuzzy DLs-based reasoning in semantic image analysis
Multimedia Tools and Applications
Thesaurus enrichment for query expansion in audiovisual archives
Multimedia Tools and Applications
Travelmedia: An intelligent management system for media captured in travel
Journal of Visual Communication and Image Representation
A visualized communication system using cross-media semantic association
MMM'11 Proceedings of the 17th international conference on Advances in multimedia modeling - Volume Part II
Aggregating semantic concepts for event representation in lifelogging
Proceedings of the International Workshop on Semantic Web Information Management
A survey of semantic image and video annotation tools
Knowledge-driven multimedia information extraction and ontology evolution
Shot retrieval based on fuzzy evolutionary aiNet and hybrid features
Computers in Human Behavior
Combining visual and textual modalities for multimedia ontology matching
SAMT'10 Proceedings of the 5th international conference on Semantic and digital media technologies
Video semantic concept detection using ontology
Proceedings of the Third International Conference on Internet Multimedia Computing and Service
Coached active learning for interactive video search
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Learning concept bundles for video search with complex queries
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Adding semantics to microblog posts
Proceedings of the fifth ACM international conference on Web search and data mining
Trends and issues in description logics frameworks for image interpretation
SETN'10 Proceedings of the 6th Hellenic conference on Artificial Intelligence: theories, models and applications
Attribute learning for understanding unstructured social activity
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part IV
Multimedia ontology matching by using visual and textual modalities
Multimedia Tools and Applications
Constructing and Utilizing Video Ontology for Accurate and Fast Retrieval
International Journal of Multimedia Data Engineering & Management
An integrated semantic-based approach in concept based video retrieval
Multimedia Tools and Applications
Proceedings of the 21st ACM international conference on Multimedia
Memory recall based video search: Finding videos you have seen before based on your memory
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Robust image retrieval with hidden classes
Computer Vision and Image Understanding
The uncertain representation ranking framework for concept-based video retrieval
Information Retrieval
Semantic context based refinement for news video annotation
Multimedia Tools and Applications
Hi-index | 0.00 |
In this paper, we propose an automatic video retrieval method based on high-level concept detectors. Research in video analysis has reached the point where over 100 concept detectors can be learned in a generic fashion, albeit with mixed performance. Such a set of detectors is very small still compared to ontologies aiming to capture the full vocabulary a user has. We aim to throw a bridge between the two fields by building a multimedia thesaurus, i.e., a set of machine learned concept detectors that is enriched with semantic descriptions and semantic structure obtained from WordNet. Given a multimodal user query, we identify three strategies to select a relevant detector from this thesaurus, namely: text matching, ontology querying, and semantic visual querying. We evaluate the methods against the automatic search task of the TRECVID 2005 video retrieval benchmark, using a news video archive of 85 h in combination with a thesaurus of 363 machine learned concept detectors. We assess the influence of thesaurus size on video search performance, evaluate and compare the multimodal selection strategies for concept detectors, and finally discuss their combined potential using oracle fusion. The set of queries in the TRECVID 2005 corpus is too small for us to be definite in our conclusions, but the results suggest promising new lines of research.