Tag-based social image retrieval: An empirical evaluation

Authors:
Aixin Sun;Sourav S. Bhowmick;Khanh Tran Nam Nguyen;Ge Bai
Affiliations:
School of Computer Engineering, Nanyang Technological University, Singapore 639798, Singapore;School of Computer Engineering, Nanyang Technological University, Singapore 639798, Singapore;School of Computer Engineering, Nanyang Technological University, Singapore 639798, Singapore;School of Computer Science, Fudan University, Shanghai 200433, P. R. China
Venue:
Journal of the American Society for Information Science and Technology
Year:
2011

Citing 0
Cited 7

CASIS: a system for concept-aware social image search

Proceedings of the 21st international conference companion on World Wide Web
Content is still king: the effect of neighbor voting schemes on tag relevance for social image retrieval

Proceedings of the 2nd ACM International Conference on Multimedia Retrieval
Detecting friday night party photos: semantics for tag recommendation

ECIR'13 Proceedings of the 35th European conference on Advances in Information Retrieval
Social image tagging using graph-based reinforcement on multi-type interrelated objects

Signal Processing
Finding impressive social content creators: searching for SNS illustrators using feedback on motifs and impressions

Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
Why not, WINE?: towards answering why-not questions in social image search

Proceedings of the 21st ACM international conference on Multimedia
Classifying tag relevance with relevant positive and negative examples

Proceedings of the 21st ACM international conference on Multimedia

Quantified Score

Hi-index	0.00

Visualization

Abstract

Tags associated with social images are valuable information source for superior image search and retrieval experiences. Although various heuristics are valuable to boost tag-based search for images, there is a lack of general framework to study the impact of these heuristics. Specifically, the task of ranking images matching a given tag query based on their associated tags in descending order of relevance has not been well studied. In this article, we take the first step to propose a generic, flexible, and extensible framework for this task and exploit it for a systematic and comprehensive empirical evaluation of various methods for ranking images. To this end, we identified five orthogonal dimensions to quantify the matching score between a tagged image and a tag query. These five dimensions are: (i) tag relatedness to measure the degree of effectiveness of a tag describing the tagged image; (ii) tag discrimination to quantify the degree of discrimination of a tag with respect to the entire tagged image collection; (iii) tag length normalization analogous to document length normalization in web search; (iv) tag-query matching model for the matching score computation between an image tag and a query tag; and (v) query model for tag query rewriting. For each dimension, we identify a few implementations and evaluate their impact on NUS-WIDE dataset, the largest human-annotated dataset consisting of more than 269K tagged images from Flickr. We evaluated 81 single-tag queries and 443 multi-tag queries over 288 search methods and systematically compare their performances using standard metrics including Precision at top-K, Mean Average Precision (MAP), Recall, and Normalized Discounted Cumulative Gain (NDCG). (This work was done during Ge Bai's intership at NTU.) © 2011 Wiley Periodicals, Inc.