A translation approach to portable ontology specifications
Knowledge Acquisition - Special issue: Current issues in knowledge modeling
VisualSEEk: a fully automated content-based image query system
MULTIMEDIA '96 Proceedings of the fourth ACM international conference on Multimedia
Using semantic contents and WordNet in image retrieval
Proceedings of the 20th annual international ACM SIGIR conference on Research and development in information retrieval
Content-Based Image Retrieval at the End of the Early Years
IEEE Transactions on Pattern Analysis and Machine Intelligence
Browsing image collections with representations of common-sense activities
Journal of the American Society for Information Science and Technology
Image Information Systems: Where Do We Go From Here?
IEEE Transactions on Knowledge and Data Engineering
Emergent semantics and the multimedia semantic web
ACM SIGMOD Record
IJCAR '01 Proceedings of the First International Joint Conference on Automated Reasoning
Supporting Content-based Queries over Images in MARS
ICMCS '97 Proceedings of the 1997 International Conference on Multimedia Computing and Systems
Ontology-Based Medical Image Annotation with Description Logics
ICTAI '03 Proceedings of the 15th IEEE International Conference on Tools with Artificial Intelligence
Grouping web image search result
Proceedings of the 12th annual ACM international conference on Multimedia
The Pyramid Match Kernel: Discriminative Classification with Sets of Image Features
ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
Probabilistic web image gathering
Proceedings of the 7th ACM SIGMM international workshop on Multimedia information retrieval
Unsupervised Learning of Categories from Sets of Partially Matching Image Features
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
MIR '06 Proceedings of the 8th ACM international workshop on Multimedia information retrieval
MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
IGroup: web image search results clustering
MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
A Hybrid Model of Image Retrieval Based on Ontology Technology and Probabilistic Ranking
WI '06 Proceedings of the 2006 IEEE/WIC/ACM International Conference on Web Intelligence
SemRetriev: an ontology driven image retrieval system
Proceedings of the 6th ACM international conference on Image and video retrieval
iScope: personalized multi-modality image search for mobile devices
Proceedings of the 7th international conference on Mobile systems, applications, and services
Semantic based retrieval system of arctic animal images
Proceedings of the 1st ACM international workshop on Multimedia analysis for ecological data
Hi-index | 0.00 |
In this paper we present an enhanced multi-modality ontology-based approach for web image retrieval step by step. Several ontology-based approaches have been made in the field of multimedia retrieval. Our multi-modality approach is one of the earliest attempts to integrate information from different modalities and apply the model in a complex domain. In order to develop the model, we need to answer the following questions: (1) how to find the proper structure and construct an ontology which can integrate information from different modalities; (2) how to quantify the matching degree (concept similarity) and provide an independent ranking mechanism; (3) how to ensure the scalability of this approach when applied to large domains. The first question has been answered by our multi-modality ontology which has been discussed in Wang et al. (Does ontology help in image retrieval? In: Asia-Pacific workshop on visual information processing, 2006) and its extension (Wang et al., Does ontology help in image retrieval?--a comparison between keyword, text ontology and multi-modality ontology approaches, ACM Press, New York, NY, USA, pp 109---112, 2006). More details about this work is given later. The main focus of this paper is that we propose a new ranking mechanism using Spearman's ranking correlation to measure the similarity of concepts in the ontology. We take the priorities of information from different modalities into consideration. This algorithm gives the answer of the second question. The semantic matchmaking result is quantized and the degree of similarity between concepts is calculated. For the third question, importing of ontology will resolve the scalability issue but computing concept similarity and identify relationships when integrating different ontologies will be beyond the scope of this paper. To convince readers that our multi-modality ontology and concept similarity ranking is the right step forward, we decided to work on the animal kingdom. We believe this domain is challenging as demonstrated by images depict animals in a wide range of aspects, pose, configurations and appearances. We experimented with a data sets of 4,000 web images. Based on ground truth, we analyze the image content and text information, build up the enhanced multi-modality ontology and compare the retrieval results. Results show that we can even classify close animal species which share similar appearances and we can infer their hidden relationships from the canine family graph. By assigning a ranking to the semantic relationships we show unequivocal evidence that our improved model achieves good accuracy and performs comparable result with the Google re-ranking result in our previous work.