Scatter/Gather: a cluster-based approach to browsing large document collections
SIGIR '92 Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval
The pragmatics of information retrieval experimentation, revisited
Information Processing and Management: an International Journal - Special issue on evaluation issues in information retrieval
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Finding and using implicit structure in human-organized spatial layouts of information
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A case for interaction: a study of interactive information retrieval behavior and effectiveness
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
HCI, natural science and design: a framework for triangulation across disciplines
DIS '97 Proceedings of the 2nd conference on Designing interactive systems: processes, practices, methods, and techniques
Use of multiple digital libraries: a case study
Proceedings of the 1st ACM/IEEE-CS joint conference on Digital libraries
Dynamic digital libraries for children
Proceedings of the 1st ACM/IEEE-CS joint conference on Digital libraries
Users' perception of privacy in multimedia communication
CHI '99 Extended Abstracts on Human Factors in Computing Systems
Evaluating usability methods: why the current literature fails the practitioner
interactions - The digital muse: HCI in support of creativity
Proceedings of the fifteenth ACM conference on Hypertext and hypermedia
WiIRE: the web interactive information retrieval experimentation system prototype
Information Processing and Management: an International Journal
Social empowerment and exclusion: A case study on digital libraries
ACM Transactions on Computer-Human Interaction (TOCHI)
User study on older adults’ use of the Web and search engines
Universal Access in the Information Society
The information seeking behaviour of the users of digital scholarly journals
Information Processing and Management: an International Journal
Information Processing and Management: an International Journal
Evaluation of the NSDL and google for obtaining pedagogical resources
ECDL'05 Proceedings of the 9th European conference on Research and Advanced Technology for Digital Libraries
Journal of the American Society for Information Science and Technology
Methods for Evaluating Interactive Information Retrieval Systems with Users
Foundations and Trends in Information Retrieval
Proceedings of the 10th annual joint conference on Digital libraries
Proceedings of the third symposium on Information interaction in context
Using a concept map to evaluate exploratory search
Proceedings of the third symposium on Information interaction in context
Information Processing and Management: an International Journal
International Journal of Human-Computer Studies
An organizational model for digital library evaluation
TPDL'11 Proceedings of the 15th international conference on Theory and practice of digital libraries: research and advanced technology for digital libraries
Flexible design for simple digital library tools and services
Proceedings of the South African Institute for Computer Scientists and Information Technologists Conference
Hi-index | 0.00 |
The strongest tradition of IR systems evaluation has focused on system effectiveness; more recently, there has been a growing interest in evaluation of Interactive IR systems, balancing system and user-oriented evaluation criteria. In this paper we shift the focus to considering how IR systems, and particularly digital libraries, can be evaluated to assess (and improve) their fit with users' broader work activities. Taking this focus, we answer a different set of evaluation questions that reveal more about the design of interfaces, user-system interactions and how systems may be deployed in the information working context. The planning and conduct of such evaluation studies share some features with the established methods for conducting IR evaluation studies, but come with a shift in emphasis; for example, a greater range of ethical considerations may be pertinent. We present the PRET A Rapporter framework for structuring user-centred evaluation studies and illustrate its application to three evaluation studies of digital library systems.