Experiments on using semantic distances between words in image caption retrieval
SIGIR '96 Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval
Toward Improved Ranking Metrics
IEEE Transactions on Pattern Analysis and Machine Intelligence
A unified framework for semantics and feature based relevance feedback in image retrieval systems
MULTIMEDIA '00 Proceedings of the eighth ACM international conference on Multimedia
SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries
IEEE Transactions on Pattern Analysis and Machine Intelligence
Unifying Keywords and Visual Contents in Image Retrieval
IEEE MultiMedia
Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
Formulating Semantic Image Annotation as a Supervised Learning Problem
CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Semantic feedback for interactive image retrieval
Proceedings of the 13th annual ACM international conference on Multimedia
Content-based multimedia information retrieval: State of the art and challenges
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Large-Scale Concept Ontology for Multimedia
IEEE MultiMedia
The Semantic Pathfinder: Using an Authoring Metaphor for Generic Multimedia Indexing
IEEE Transactions on Pattern Analysis and Machine Intelligence
High-dimensional visual vocabularies for image retrieval
SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
Cluster-based data modeling for semantic video search
Proceedings of the 6th ACM international conference on Image and video retrieval
Information-theoretic semantic multimedia indexing
Proceedings of the 6th ACM international conference on Image and video retrieval
How many high-level concepts will fill the semantic gap in news video retrieval?
Proceedings of the 6th ACM international conference on Image and video retrieval
Semantic concept-based query expansion and re-ranking for multimedia retrieval
Proceedings of the 15th international conference on Multimedia
Modeling Semantic Aspects for Cross-Media Image Indexing
IEEE Transactions on Pattern Analysis and Machine Intelligence
Multiple Bernoulli relevance models for image and video annotation
CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Automated image annotation using global features and robust nonparametric density estimation
CIVR'05 Proceedings of the 4th international conference on Image and Video Retrieval
Fractional distance measures for content-based image retrieval
ECIR'05 Proceedings of the 27th European conference on Advances in Information Retrieval Research
CIVR'06 Proceedings of the 5th international conference on Image and Video Retrieval
An active learning framework for content-based information retrieval
IEEE Transactions on Multimedia
Bridging the Gap: Query by Semantic Example
IEEE Transactions on Multimedia
Learning a semantic space from user's relevance feedback for image retrieval
IEEE Transactions on Circuits and Systems for Video Technology
From usage to annotation: analysis of personal photo albums for semantic photo understanding
WSM '09 Proceedings of the first SIGMM workshop on Social media
Inferring semantic concepts from community-contributed images and noisy tags
MM '09 Proceedings of the 17th ACM international conference on Multimedia
Integrating web 2.0 resources by wikipedia
Proceedings of the international conference on Multimedia
Challenges from information extraction to information fusion
COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Enhancing multi-lingual information extraction via cross-media inference and fusion
COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Using manual and automated annotations to search images by semantic similarity
Multimedia Tools and Applications
| Hi-index | 0.00 |
We address the problem of searching multimedia by semantic similarity in a keyword space. In contrast to previous research we represent multimedia content by a vector of keywords instead of a vector of low-level features. This vector of keywords can be obtained through user manual annotations or computed by an automatic annotation algorithm. In this setting, we studied the influence of two aspects of the search by semantic similarity process: (1) accuracy of user keywords versus automatic keywords and (2) functions to compute semantic similarity between keyword vectors of two multimedia documents. We consider these two aspects to be crucial in the design of a keyword space that can exploit social-media information and can enrich applications such as Flickr and YouTube. Experiments were performed on an image and a video dataset with a large number of keywords, with different similarity functions and with two annotation methods. Surprisingly, we found that multimedia semantic similarity with automatic keywords performs as good as or better than 95% accurate user keywords.