Evaluation measures for interactive information retrieval
Information Processing and Management: an International Journal - Special issue on evaluation issues in information retrieval
Audience engagement in multimedia presentations
ACM SIGMIS Database
Understanding and facilitating the browsing of electronic text
International Journal of Human-Computer Studies
Computers as Theatre
Emotion & design: attractive things work better
interactions
Developing and validating an instrument for measuring user-perceived web quality
Information and Management
A person-artefact-task (PAT) model of flow antecedents in computer-mediated environments
International Journal of Human-Computer Studies - Special issue on HCI and MIS
WiIRE: the web interactive information retrieval experimentation system prototype
Information Processing and Management: an International Journal
Technology as Experience
Questionnaire mode effects in interactive information retrieval experiments
Information Processing and Management: an International Journal
Information and Management
Putting ‘felt-life’ at the centre of human–computer interaction (HCI)
Cognition, Technology and Work
What is user engagement? A conceptual framework for defining user engagement with technology
Journal of the American Society for Information Science and Technology
Exploratory Search
Methods for Evaluating Interactive Information Retrieval Systems with Users
Foundations and Trends in Information Retrieval
The development and evaluation of a survey to measure user engagement
Journal of the American Society for Information Science and Technology
Sampling high-quality clicks from noisy click data
Proceedings of the 19th international conference on World wide web
Interactive information retrieval
Annual Review of Information Science and Technology
wikiSearch: from access to use
ECDL'09 Proceedings of the 13th European conference on Research and advanced technology for digital libraries
A review of factors influencing user satisfaction in information retrieval
Journal of the American Society for Information Science and Technology
Proceedings of the third symposium on Information interaction in context
The effect of user characteristics on search effectiveness in information retrieval
Information Processing and Management: an International Journal
UMAP'12 Proceedings of the 20th international conference on User Modeling, Adaptation, and Personalization
Evaluating books finding tools on social media: A case study of aNobii
Information Processing and Management: an International Journal
Measuring engagement in video game-based environments: Investigation of the User Engagement Scale
Computers in Human Behavior
Hi-index | 0.00 |
The user experience is an integral component of interactive information retrieval (IIR). However, there is a twofold problem in its measurement. Firstly, while many IIR studies have relied on a single dimension of user feedback, that of satisfaction, experience is a much more complex concept. IIR in general, and exploratory search more specifically, are dynamic, multifaceted experiences that evoke pragmatic and hedonic needs, expectations, and outcomes that are not adequately captured by user satisfaction. Secondly, questionnaires, which are typically the means in which user's attitudes and perceptions are measured, are not typically subjected to rigorous reliability and validity testing. To address these issues, we administered the multidimensional User Engagement Scale (UES) in an exploratory search environment to assess users' perceptions of the Perceived Usability (PUs), Aesthetics (AE), Novelty (NO), Felt Involvement (FI), Focused Attention (FA), and Endurability (EN) aspects of the experience. In a typical laboratory-style study, 381 participants performed three relatively complex search tasks using a novel search interface, and responded to the UES immediately upon completion. We used Principal Axis Factor Analysis and Multiple Regression to examine the factor structure of UES items and the relationships amongst factors. Results showed that three of the six sub-scales (PUs, AE, FA) were stable, while NO, FI and EN merged to form a single factor. We discuss recommendations for revising and validating the UES in light of these findings.