A bootstrapping approach to annotating large image collection
MIR '03 Proceedings of the 5th ACM SIGMM international workshop on Multimedia information retrieval
Detecting image near-duplicate by stochastic attributed relational graph matching with learning
Proceedings of the 12th annual ACM international conference on Multimedia
Semantic categorization of digital home photo using photographic region templates
Information Processing and Management: an International Journal - Special issue: AIRS2005: Information retrieval research in Asia
Semi-supervised learning for semantic video retrieval
Proceedings of the 6th ACM international conference on Image and video retrieval
A reranking approach for context-based concept fusion in video indexing and retrieval
Proceedings of the 6th ACM international conference on Image and video retrieval
An empirical study of inter-concept similarities in multimedia ontologies
Proceedings of the 6th ACM international conference on Image and video retrieval
Semantic context detection using audio event fusion: camera-ready version
EURASIP Journal on Applied Signal Processing
Adapting appearance models of semantic concepts to particular videos via transductive learning
Proceedings of the international workshop on Workshop on multimedia information retrieval
Building a comprehensive ontology to refine video concept detection
Proceedings of the international workshop on Workshop on multimedia information retrieval
Correlative multi-label video annotation
Proceedings of the 15th international conference on Multimedia
Refining video annotation by exploiting pairwise concurrent relation
Proceedings of the 15th international conference on Multimedia
An integrated statistical model for multimedia evidence combination
Proceedings of the 15th international conference on Multimedia
Semantic concept-based query expansion and re-ranking for multimedia retrieval
Proceedings of the 15th international conference on Multimedia
Modeling Semantic Aspects for Cross-Media Image Indexing
IEEE Transactions on Pattern Analysis and Machine Intelligence
Correlative multilabel video annotation with temporal kernels
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Multi-cue fusion for semantic video indexing
MM '08 Proceedings of the 16th ACM international conference on Multimedia
Fusing semantics, observability, reliability and diversity of concept detectors for video search
MM '08 Proceedings of the 16th ACM international conference on Multimedia
Image retrieval using query by contextual example
MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
CuZero: embracing the frontier of interactive visual search for informed users
MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
Ontology-Based Inter-concept Relation Fusion for Concept Detection
PCM '08 Proceedings of the 9th Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
Concept representation based video indexing
Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
Foundations and Trends in Information Retrieval
Exploring inter-concept relationship with context space for semantic video indexing
Proceedings of the ACM International Conference on Image and Video Retrieval
IEEE Transactions on Circuits and Systems for Video Technology
Combining intra-image and inter-class semantics for consumer image retrieval
Pattern Recognition
Learning concepts by modeling relationships
MCAM'07 Proceedings of the 2007 international conference on Multimedia content analysis and mining
FaericWorld: browsing multimedia events through static documents and links
INTERACT'07 Proceedings of the 11th IFIP TC 13 international conference on Human-computer interaction
Semantic video indexing by fusing explicit and implicit context spaces
Proceedings of the international conference on Multimedia
Automatic event-based indexing of multimedia content using a joint content-event model
Proceedings of the 2nd ACM international workshop on Events in multimedia
Prosemantic features for content-based image retrieval
AMR'09 Proceedings of the 7th international conference on Adaptive multimedia retrieval: understanding media and adapting to the user
High-level event detection system based on discriminant visual concepts
Proceedings of the 1st ACM International Conference on Multimedia Retrieval
Ensemble multi-instance multi-label learning approach for video annotation task
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Ensemble approach based on conditional random field for multi-label image and video annotation
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Home photo categorization based on photographic region templates
AIRS'05 Proceedings of the Second Asia conference on Asia Information Retrieval Technology
Multimedia research challenges for industry
CIVR'05 Proceedings of the 4th international conference on Image and Video Retrieval
A fuzzy ontology: based framework for reasoning in visual video content analysis and indexing
Proceedings of the Eleventh International Workshop on Multimedia Data Mining
Halfway through the semantic gap: Prosemantic features for image retrieval
Information Sciences: an International Journal
Probabilistic semantic component descriptor
Multimedia Tools and Applications
Attributes for classifier feedback
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part III
Objects as attributes for scene classification
ECCV'10 Proceedings of the 11th European conference on Trends and Topics in Computer Vision - Volume Part I
A reward-and-punishment-based approach for concept detection using adaptive ontology rules
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Temporal-Spatial refinements for video concept fusion
ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part III
Zero-shot video retrieval using content and concepts
Proceedings of the 22nd ACM international conference on Conference on information & knowledge management
Multimedia event detection with multimodal feature fusion and temporal concept localization
Machine Vision and Applications
Hi-index | 0.00 |
In this paper we propose a novel method for multimedia semantic indexing using model vectors. Model vectors provide a semantic signature for multimedia documents by capturing the detection of concepts broadly across a lexicon using a set of independent binary classifiers. While recent techniques have been developed for detecting simple generic concepts such as indoors, outdoors, nature, manmade, faces, people, speech, music, and so forth [W.H. Adams et al., November 2002], these labels directly support only a small number of queries. Model vectors address the problem of answering queries for which relationships to specific concepts is either unknown or indirect by developing a basis across across the lexicon. In the simplest case, each model vector dimension corresponds to the confidence score by which a corresponding concept from the lexicon is detected. However, we show how other information such as relevance, reliability and concept correlation can also be incorporated. Overall, the model vectors can be used in a variety of methods for multimedia indexing, including model-based retrieval, relevance feedback searching and concept querying. In this paper, we present the model vector method and study different strategies for computing and comparing model vectors. We empirically evaluate the retrieval effectiveness of the model vector approach compared to other search methods in a large video retrieval testbed.