Visual and semantic similarity in ImageNet

Authors:
T. Deselaers;V. Ferrari
Affiliations:
Comput. Vision Lab., ETH Zurich, Zurich, Switzerland;Comput. Vision Lab., ETH Zurich, Zurich, Switzerland
Venue:
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Year:
2011

Citing 0
Cited 13

A method for enhancing image retrieval based on annotation using modified WUP similarity in WordNet

AIKED'12 Proceedings of the 11th WSEAS international conference on Artificial Intelligence, Knowledge Engineering and Data Bases
Improving Image Classification Using Semantic Attributes

International Journal of Computer Vision
Towards data-driven estimation of image tag relevance using visually similar and dissimilar folksonomy images

Proceedings of the 2012 international workshop on Socially-aware multimedia
On shape and the computability of emotions

Proceedings of the 20th ACM international conference on Multimedia
Joint statistical analysis of images and keywords with applications in semantic image enhancement

Proceedings of the 20th ACM international conference on Multimedia
Towards indexing representative images on the web

Proceedings of the 20th ACM international conference on Multimedia
Modeling semantic relations between visual attributes and object categories via dirichlet forest prior

Proceedings of the 21st ACM international conference on Information and knowledge management
Dog breed classification using part localization

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part I
Measuring image distances via embedding in a semantic manifold

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part IV
Neti Neti: in search of deity

Proceedings of the Eighth Indian Conference on Computer Vision, Graphics and Image Processing
Semi-Supervised learning on a budget: scaling up to large datasets

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part I
Attribute-augmented semantic hierarchy: towards bridging semantic gap and intention gap in image retrieval

Proceedings of the 21st ACM international conference on Multimedia
Picture tags and world knowledge: learning tag relations from visual semantic sources

Proceedings of the 21st ACM international conference on Multimedia

Quantified Score

Hi-index	0.00

Visualization

Abstract

Many computer vision approaches take for granted positive answers to questions such as "Are semantic categories visually separable?" and "Is visual similarity correlated to semantic similarity?". In this paper, we study experimentally whether these assumptions hold and show parallels to questions investigated in cognitive science about the human visual system. The insights gained from our analysis enable building a novel distance function between images assessing whether they are from the same basic-level category. This function goes beyond direct visual distance as it also exploits semantic similarity measured through ImageNet. We demonstrate experimentally that it outperforms purely visual distances.