Learning the semantics of multimedia queries and concepts from a small number of examples
Proceedings of the 13th annual ACM international conference on Multimedia
Multimedia semantic indexing using model vectors
ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 1
Video search reranking via information bottleneck principle
MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Probabilistic models for combining diverse knowledge sources in multimedia retrieval
Probabilistic models for combining diverse knowledge sources in multimedia retrieval
Multimedia search with pseudo-relevance feedback
CIVR'03 Proceedings of the 2nd international conference on Image and video retrieval
Learned lexicon-driven interactive video retrieval
CIVR'06 Proceedings of the 5th international conference on Image and Video Retrieval
Proceedings of the 15th international conference on Multimedia
Multi-cue fusion for semantic video indexing
MM '08 Proceedings of the 16th ACM international conference on Multimedia
Fusing semantics, observability, reliability and diversity of concept detectors for video search
MM '08 Proceedings of the 16th ACM international conference on Multimedia
Bayesian video search reranking
MM '08 Proceedings of the 16th ACM international conference on Multimedia
ContextSeer: context search and recommendation at query time for shared consumer photos
MM '08 Proceedings of the 16th ACM international conference on Multimedia
Keyword-based concept search on consumer photos by web-based kernel function
MM '08 Proceedings of the 16th ACM international conference on Multimedia
Modeling video hyperlinks with hypergraph for web video reranking
MM '08 Proceedings of the 16th ACM international conference on Multimedia
CuZero: embracing the frontier of interactive visual search for informed users
MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
Optimizing video search reranking via minimum incremental information loss
MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
Query representation by structured concept threads with application to interactive video retrieval
Journal of Visual Communication and Image Representation
CrowdReranking: exploring multiple search engines for visual search reranking
Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
Foundations and Trends in Information Retrieval
Exploring inter-concept relationship with context space for semantic video indexing
Proceedings of the ACM International Conference on Image and Video Retrieval
Refining image retrieval using one-class classification
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Multigraph-based query-independent learning for video search
IEEE Transactions on Circuits and Systems for Video Technology
IEEE Transactions on Circuits and Systems for Video Technology
SNDocRank: a social network-based video search ranking framework
Proceedings of the international conference on Multimedia information retrieval
Comparing compact codebooks for visual categorization
Computer Vision and Image Understanding
Active reranking for web image search
IEEE Transactions on Image Processing
Today's and tomorrow's retrieval practice in the audiovisual archive
Proceedings of the ACM International Conference on Image and Video Retrieval
Semantic video indexing by fusing explicit and implicit context spaces
Proceedings of the international conference on Multimedia
Re-ranking for multimedia indexing and retrieval
ECIR'11 Proceedings of the 33rd European conference on Advances in information retrieval
Re-ranking by local re-scoring for video indexing and retrieval
Proceedings of the 20th ACM international conference on Information and knowledge management
Mining concept relationship in temporal context for effective video annotation
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Multimedia Tools and Applications
Collaborative video reindexing via matrix factorization
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
A fuzzy ontology: based framework for reasoning in visual video content analysis and indexing
Proceedings of the Eleventh International Workshop on Multimedia Data Mining
Keyword-propagation-based information enriching and noise removal for web news videos
Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining
Hamming selection pruned sets (HSPS) for efficient multi-label video classification
PRICAI'12 Proceedings of the 12th Pacific Rim international conference on Trends in Artificial Intelligence
Multimedia search reranking: A literature survey
ACM Computing Surveys (CSUR)
Using contextual spaces for image re-ranking and rank aggregation
Multimedia Tools and Applications
Hi-index | 0.00 |
We propose to incorporate hundreds of pre-trained concept detectors to provide contextual information for improving the performance of multimodal video search. The approach takes initial search results from established video search methods (which typically are conservative in usage of concept detectors) and mines these results to discover and leverage co-occurrence patterns with detection results for hundreds of other concepts, thereby refining and reranking the initial video search result. We test the method on TRECVID 2005 and 2006 automatic video search tasks and find improvements in mean average precision (MAP) of 15%-30%. We also find that the method is adept at discovering contextual relationships that are unique to news stories occurring in the search set, which would be difficult or impossible to discover even if external training data were available.