Using concept hierarchies in text-based image retrieval: a user evaluation

Authors:
Daniela Petrelli;Paul Clough
Affiliations:
Department of Information Studies, University of Sheffield, Sheffield, UK;Department of Information Studies, University of Sheffield, Sheffield, UK
Venue:
CLEF'05 Proceedings of the 6th international conference on Cross-Language Evalution Forum: accessing Multilingual Information Repositories
Year:
2005

Citing 6
Cited 1

Development of an instrument measuring user satisfaction of the human-computer interface

CHI '88 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Deriving concept hierarchies from text

Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval
Measuring usability: are effectiveness, efficiency, and satisfaction really correlated?

Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Observing users, designing clarity: a case study on the user-centered design of a cross-language information retrieval system

Journal of the American Society for Information Science and Technology
Which user interaction for cross-language information retrieval? Design issues and reflections

Journal of the American Society for Information Science and Technology
Selection and merging strategies for multilingual information retrieval

CLEF'04 Proceedings of the 5th conference on Cross-Language Evaluation Forum: multilingual Information Access for Text, Speech and Images

On the role of user-centred evaluation in the advancement of interactive information retrieval

Information Processing and Management: an International Journal

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes our results from the image retrieval task of iCLEF 2005 based on a comparative user evaluation of two interfaces: one displaying search results as a list; the other organising retrieved images into a hierarchy of concepts displayed on the interface as an interactive menu. Based on a known-item retrieval task, data was analysed with respect to effectiveness, efficiency and user satisfaction. Effectiveness and efficiency were calculated at both the set cut-off time of 5 minutes, and the time after finding the target image (final time). Results showed the list was marginally more effective than the menu at 5 minutes, but the two were equal at final time indicating the menu requires more time to be used effectively. The list was more efficient at both 5 minutes and final time (difference not statistically significant) and users preferred using the menu indicating this could be a potentially interesting and engaging feature for image retrieval.