Some measures and procedures for evaluation of the user interface in an information retrieval system
SIGIR '88 Proceedings of the 11th annual international ACM SIGIR conference on Research and development in information retrieval
The relevance of recall and precision in user evaluation
Journal of the American Society for Information Science - Special issue: relevance research
ACM Transactions on Computer-Human Interaction (TOCHI)
Scatter/gather browsing communicates the topic structure of a very large text collection
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Evaluation of a tool for visualization of information retrieval results
SIGIR '96 Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval
Evaluating user interfaces to information retrieval systems: a case study on user support
SIGIR '96 Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval
Effectiveness of a graphical display of retrieval results
Proceedings of the 20th annual international ACM SIGIR conference on Research and development in information retrieval
Interaction in information retrieval: trends over time
Journal of the American Society for Information Science - Special issue on the 50th anniversary of the Journal of The American Society for Information Science: part 2: paradigms, models and methods of information science
Analysis of a very large web search engine query log
ACM SIGIR Forum
Measuring usability: are effectiveness, efficiency, and satisfaction really correlated?
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Differences between novice and experienced users in searching information on the World Wide Web
Journal of the American Society for Information Science - Special topic issue: individual differences in virtual environments
Searching the Web: the public and their queries
Journal of the American Society for Information Science and Technology
A review of web searching studies and a framework for future research
Journal of the American Society for Information Science and Technology
Using thumbnails to search the Web
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Optimizing search by showing results in context
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Keeping found things found on the web
Proceedings of the tenth international conference on Information and knowledge management
Finding relevant documents using top ranking sentences: an evaluation of two alternative schemes
SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Using terminological feedback for web search refinement: a log-based study
Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
A task-oriented study on the influencing effects of query-biased summarisation in web searching
Information Processing and Management: an International Journal
WaveLens: a new view onto Internet search results
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proportional search interface usability measures
Proceedings of the third Nordic conference on Human-computer interaction
Findex: search result categories help users when document ranking fails
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Optimizing the number of search result categories
CHI '05 Extended Abstracts on Human Factors in Computing Systems
Journal of the American Society for Information Science and Technology
Information search and re-access strategies of experienced web users
WWW '05 Proceedings of the 14th international conference on World Wide Web
Mix and match: combining terms and operators for successful web searches
Information Processing and Management: an International Journal
Visualizing Query Occurrence in Search Result Lists
IV '05 Proceedings of the Ninth International Conference on Information Visualisation
User study on older adults’ use of the Web and search engines
Universal Access in the Information Society
fKWIC: Frequency-based keyword-in-context index for filtering Web search results
Journal of the American Society for Information Science and Technology
Modeling successful performance in Web searching
Journal of the American Society for Information Science and Technology
Findex: improving search result use through automatic filtering categories
Interacting with Computers
Improving web search transparency by using a Venn diagram interface
Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges
Are concepts useful for organizing search results?
BCS-HCI '08 Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction - Volume 2
Methods for Evaluating Interactive Information Retrieval Systems with Users
Foundations and Trends in Information Retrieval
ACM Transactions on Information Systems (TOIS)
Biomedical information retrieval: the BioTracer approach
ITBAM'10 Proceedings of the First international conference on Information technology in bio- and medical informatics
Platform for extraction, visualization and analysis of search trends
Proceedings of the 8th International Conference on Frontiers of Information Technology
Web searching for health: theoretical foundations for analyzing problematic search engine use
SocInfo'11 Proceedings of the Third international conference on Social informatics
Supporting biomedical information retrieval: the bioTracer approach
Transactions on large-scale data- and knowledge-centered systems IV
Visual Abstraction and Ordering in Faceted Browsing of Text Collections
ACM Transactions on Intelligent Systems and Technology (TIST)
Human-Computer interaction view on information retrieval evaluation
PROMISE'12 Proceedings of the 2012 international conference on Information Retrieval Meets Information Visualization
The water filling model and the cube test: multi-dimensional evaluation for professional search
Proceedings of the 22nd ACM international conference on Conference on information & knowledge management
| Hi-index | 0.00 |
Over time, researchers have acknowledged the importance of understanding the users' strategies in the design of search systems. However, when involving users in the comparison of search systems, methodological challenges still exist as researchers are pondering on how to handle the variability that human participants bring to the comparisons. This paper present methods for controlling the complexity of user-centered evaluations of search user interfaces through within-subjects designs, balanced task sets, time limitations, pre-formulated queries, cached result pages, and through limiting the users' access to result documents. Additionally, we will present our experiences in using three measures - search speed, qualified search speed, and immediate accuracy - to facilitate the comparison of different search systems over studies.