On the consistency and features of image similarity

Authors:
Pierre Tirilly;Xiangming Mu;Chunsheng Huang;Iris Xie;Wooseob Jeong;Jin Zhang
Affiliations:
University of Wisconsin-Milwaukee, Milwaukee, WI;University of Wisconsin-Milwaukee, Milwaukee, WI;University of Wisconsin-Milwaukee, Milwaukee, WI;University of Wisconsin-Milwaukee, Milwaukee, WI;University of Wisconsin-Milwaukee, Milwaukee, WI;University of Wisconsin-Milwaukee, Milwaukee, WI
Venue:
Proceedings of the 4th Information Interaction in Context Symposium
Year:
2012

Citing 17
Cited 1

Content-Based Image Retrieval at the End of the Early Years

IEEE Transactions on Pattern Analysis and Machine Intelligence
Does organisation by similarity assist image browsing?

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A conceptual framework and empirical research for classifying visual descriptors

Journal of the American Society for Information Science and Technology
The Truth about Corel - Evaluation in Image Retrieval

CIVR '02 Proceedings of the International Conference on Image and Video Retrieval
Effective browsing of web image search results

Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval
Classification of user image descriptions

International Journal of Human-Computer Studies
Image retrieval and perceptual similarity

ACM Transactions on Applied Perception (TAP)
Learning generative visual models from few training examples: An incremental Bayesian approach tested on 101 object categories

Computer Vision and Image Understanding
Web image retrieval on ImagEVAL: evidences on visualness and textualness concept dependency in fusion model

Proceedings of the 6th ACM international conference on Image and video retrieval
LabelMe: A Database and Web-Based Tool for Image Annotation

International Journal of Computer Vision
The MIR flickr retrieval evaluation

MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
A New Baseline for Image Annotation

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part III
Hamming Embedding and Weak Geometric Consistency for Large Scale Image Search

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part I
Collective indexing of emotions in images. A study in emotional information retrieval

Journal of the American Society for Information Science and Technology
Reliable tags using image similarity: mining specificity and expertise from large-scale multimedia databases

WSMC '09 Proceedings of the 1st workshop on Web-scale multimedia corpus
Semantic combination of textual and visual information in multimedia retrieval

Proceedings of the 1st ACM International Conference on Multimedia Retrieval
The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments

IEEE Transactions on Image Processing

Report on IIiX'12: the fourth information interaction in context symposium

ACM SIGIR Forum

Quantified Score

Hi-index	0.00

Visualization

Abstract

Image indexing and retrieval systems mostly rely on the computation of similarity measures between images. This notion is ill-defined, generally based on simplistic assumptions that do not fit the actual context of use of image retrieval systems. This paper addresses two fundamental issues related to image similarity: checking whether the degree of similarity between two images is perceived consistently by different users and establishing the elements of the images on which users base their similarity judgment. A study is set up, in which human subjects have been asked to assess the degree of the pairwise similarity of images and describe the features on which they base their judgments. The quantitative analysis of the similarity scores reported by the subjects shows that users reach a certain consensus on similarity assessment. From the qualitative analysis of the transcripts of the records of the experiments, a list of the features used by the subjects to assess image similarity is built. From this, a new model of image description emerges. As compared to existing models, it is more realistic, free of preconceptions and more suited to the task of similarity computation. These results are discussed from the perspectives of psychology and computer science.