Exploring evaluation criteria of social navigational tools on social media: a case study of aNobii

Authors:
Muh-Chyun Tang;Pei-Hang Ting;Yi-Jin Sie
Affiliations:
National Taiwan University, Taipei, Taiwan (R.O.C.);National Taiwan University, Taipei, Taiwan (R.O.C.);National Taiwan University, Taipei, Taiwan (R.O.C.)
Venue:
Proceedings of the 4th Information Interaction in Context Symposium
Year:
2012

Citing 9
Cited 0

Supporting social navigation on the World Wide Web

International Journal of Human-Computer Studies - Special issue: innovative applications of the World Wide Web
The intellectual foundation of information organization

The intellectual foundation of information organization
Finding without seeking: the information encounter in the context of reading for pleasure

Information Processing and Management: an International Journal - Special issue on Information Seeking In Context (ISIC)
Social navigation of food recipes

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
On recommending

Journal of the American Society for Information Science and Technology
Evaluating collaborative filtering recommender systems

ACM Transactions on Information Systems (TOIS)
Recommender Systems Research: A Connection-Centric Survey

Journal of Intelligent Information Systems
Exploratory search: from finding to understanding

Communications of the ACM - Supporting exploratory search
Editorial: Evaluating exploratory search systems

Information Processing and Management: an International Journal

Quantified Score

Hi-index	0.00

Visualization

Abstract

A user study of aNobii was conducted to compare its three book-finding tools: author search, browsing friends' bookshelves and browsing similar bookshelves. The construct of "social navigation" was identified as a useful theoretical framework to discuss various modes of information access on social media. A within-subject experimental design was adopted where all forty regular aNobii users searched alternately with the three book-finding tools. Several novel evaluation measures were designed to explore the potential benefits these tools might bring to the users. Other than the self-report user experience and search result measures, the "consideration set" model was used as a novel framework for navigational effectiveness. Some major findings are as follows. While the author search function was shown to be the most efficient, browsing friends' bookshelves was shown to generate more interesting and informative browsing experience. Three evaluative dimensions were derived from our study: search experience, search efficiency, and search result quality. The disagreement of these measures shows a need for a multi-faceted evaluative framework for these exploration-based navigational tools.