A user study on features supporting subjective relevance for information retrieval interfaces

Authors:
Shu-Shing Lee;Yin-Leng Theng;Dion Hoe-Lian Goh;Schubert Shou-Boon Foo
Affiliations:
Division of Information Studies, School of Communication and Information, Nanyang Technological University, Singapore;Division of Information Studies, School of Communication and Information, Nanyang Technological University, Singapore;Division of Information Studies, School of Communication and Information, Nanyang Technological University, Singapore;Division of Information Studies, School of Communication and Information, Nanyang Technological University, Singapore
Venue:
ICADL'06 Proceedings of the 9th international conference on Asian Digital Libraries: achievements, Challenges and Opportunities
Year:
2006

Citing 7
Cited 1

User-defined relevance criteria: an exploratory study

Journal of the American Society for Information Science - Special issue: relevance research
Toward an understanding of the dynamics of relevance judgement: an analysis of one person's search behavior

Information Processing and Management: an International Journal
Measures of relative relevance and ranked half-life: performance indicators for interactive IR

Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
Dimensions of relevance

Information Processing and Management: an International Journal
Designing a digital library for young children

Proceedings of the 1st ACM/IEEE-CS joint conference on Digital libraries
Designing the User Interface: Strategies for Effective Human-Computer Interaction

Designing the User Interface: Strategies for Effective Human-Computer Interaction
An exploratory factor analytic approach to understand design features for academic learning environments

ECDL'06 Proceedings of the 10th European conference on Research and Advanced Technology for Digital Libraries

A factor analytic approach towards determining mobile tourism services

Proceedings of the 11th International Conference on Electronic Commerce

Quantified Score

Hi-index	0.00

Visualization

Abstract

Objective relevance regards retrieved documents as relevant without considering users' tasks. Subjective relevance, in contrast, focuses on usefulness of documents for users' contexts. This paper aims to enhance objective relevance and address its limitations by designing a mock-up interface based on ACM Digital Library so as to enhance its support for users' evaluating the subjective relevance of documents. Important features elicited using a factor analytic approach from an earlier study were used to inform the design of the search, results list and document record pages in the mock-up. A pilot study was conducted to gather users' feedback about usefulness of designed features. Findings indicated that majority of important features designed were useful. However, subjects suggested that the design of some features could be further improved to facilitate their support for SR. The paper concludes by discussing recommendations for improving the mock-up.