The pragmatics of information retrieval experimentation, revisited
Information Processing and Management: an International Journal - Special issue on evaluation issues in information retrieval
Characterizing browsing strategies in the World-Wide Web
Proceedings of the Third International World-Wide Web conference on Technology, tools and applications
Information seeking in electronic environments
Information seeking in electronic environments
An evaluation of interactive Boolean and natural language searching with an online medical textbook
Journal of the American Society for Information Science
Some perspectives on the evaluation of information retrieval systems
Journal of the American Society for Information Science - Special issue: evaluation of information retrieval systems
Evaluating interactive systems in TREC
Journal of the American Society for Information Science - Special issue: evaluation of information retrieval systems
A study of the use of variables in information retrieval user studies
Journal of the American Society for Information Science
The Internet as a medium for software engineering experiments
Proceedings of the 21st international conference on Software engineering
Discriminating meta-search: a framework for evaluation
Information Processing and Management: an International Journal - Special issue on progress toward digital libraries
Using the Internet for survey research: a case study
Journal of the American Society for Information Science - Special topic issue: When museum informatics meets the World Wide Web
Users' interaction with World Wide Web resources: an exploratory study using a holistic approach
Information Processing and Management: an International Journal
Understanding and facilitating the browsing of electronic text
International Journal of Human-Computer Studies
Web search behavior of Internet experts and newbies
Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking
Information Processing and Management: an International Journal - Special issue on interactivity at the text retrieval conference (TREC)
WebQuilt: A proxy-based approach to remote web usability testing
ACM Transactions on Information Systems (TOIS)
Differences and similarities in information seeking: children and adults as web users
Information Processing and Management: an International Journal - Issues of context in information retrieval
User strategies for handling information tasks in webcasts
CHI '05 Extended Abstracts on Human Factors in Computing Systems
Assessing tools for use with webcasts
Proceedings of the 5th ACM/IEEE-CS joint conference on Digital libraries
Information Processing and Management: an International Journal
Questionnaire mode effects in interactive information retrieval experiments
Information Processing and Management: an International Journal
Effects of performance feedback on users' evaluations of an interactive IR system
Proceedings of the second international symposium on Information interaction in context
Task Effects on Interactive Search: The Query Factor
Focused Access to XML Documents
Methods for Evaluating Interactive Information Retrieval Systems with Users
Foundations and Trends in Information Retrieval
ACM Transactions on Information Systems (TOIS)
Understanding how webcasts are used as sources of information
Journal of the American Society for Information Science and Technology
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
SCAMP: a tool for conducting interactive information retrieval experiments
Proceedings of the 4th Information Interaction in Context Symposium
How is a search system used in work task completion?
Journal of Information Science
Examining the generalizability of the User Engagement Scale (UES) in exploratory search
Information Processing and Management: an International Journal
Hi-index | 0.00 |
We introduce WiIRE, a prototype system for conducting: interactive information retrieval (IIR) experiments via the Internet. We conceived WiIRE to increase validity while streamlining procedures and adding efficiencies to the conduct of IIR experiments. The system incorporates password-controlled access, online questionnaires, study instructions and tutorials, conditional interface assignment, and conditional query assignment as well as provision for data collection. As an initial evaluation, we used WiIRE inhouse to conduct a Web-based IIR experiment using an external search engine with customized search interfaces and the TREC 11 Interactive Track search queries. Our evaluation of the prototype indicated significant cost efficiencies in the conduct of IIR studies, and additionally had some novel findings about the human perspective: about half participants would have preferred some personal contact with the researcher, and participants spent a significantly decreasing amount of time on tasks over the course of a session.