User interface evaluation in the real world: a comparison of four techniques
CHI '91 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Organizational obstacles to interface design and development: two participant-observer studies
ACM Transactions on Computer-Human Interaction (TOCHI)
Methodology matters: doing research in the behavioral and social sciences
Human-computer interaction
Contextual design: defining customer-centered systems
Contextual design: defining customer-centered systems
Empirical evaluation of information visualizations: an introduction
International Journal of Human-Computer Studies - Empirical evaluation of information visualizations
Beyond Interaction Design: Beyond Human-Computer Interaction
Beyond Interaction Design: Beyond Human-Computer Interaction
Benefits of Information Visualization Systems for Administrative Data Analysts
IV '03 Proceedings of the Seventh International Conference on Information Visualization
Human Factors in Visualization Research
IEEE Transactions on Visualization and Computer Graphics
The challenge of information visualization evaluation
Proceedings of the working conference on Advanced visual interfaces
The state of user-centered design practice
Communications of the ACM - The disappearing computer
An Insight-Based Methodology for Evaluating Bioinformatics Visualizations
IEEE Transactions on Visualization and Computer Graphics
Evaluating Visualizations: Do Expert Reviews Work?
IEEE Computer Graphics and Applications
An explorative analysis of user evaluation studies in information visualisation
Proceedings of the 2006 AVI workshop on BEyond time and errors: novel evaluation methods for information visualization
Proceedings of the 2006 AVI workshop on BEyond time and errors: novel evaluation methods for information visualization
An Insight-Based Longitudinal Study of Visual Analytics
IEEE Transactions on Visualization and Computer Graphics
Human-Computer Interaction (3rd Edition)
Human-Computer Interaction (3rd Edition)
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
LiveRAC: interactive visual exploration of system management time-series data
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Productivity as a metric for visual analytics: reflections on e-discovery
Proceedings of the 2008 Workshop on BEyond time and errors: novel evaLuation methods for Information Visualization
Grounded evaluation of information visualizations
Proceedings of the 2008 Workshop on BEyond time and errors: novel evaLuation methods for Information Visualization
Qualitative analysis of visualization: a building design field study
Proceedings of the 2008 Workshop on BEyond time and errors: novel evaLuation methods for Information Visualization
Obstacles to usability evaluation in practice: a survey of software development organizations
Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges
Driving user centered design into IT organizations: is it possible?
CHI '09 Extended Abstracts on Human Factors in Computing Systems
Towards the Big Picture: Enriching 3D Models with Information Visualisation and Vice Versa
SG '09 Proceedings of the 10th International Symposium on Smart Graphics
User-Centered Development of a Visual Exploration System for In-Car Communication
SG '09 Proceedings of the 10th International Symposium on Smart Graphics
MostVis: An Interactive Visualization Supporting Automotive Engineers in MOST Catalog Exploration
IV '09 Proceedings of the 2009 13th International Conference Information Visualisation
A Nested Model for Visualization Design and Validation
IEEE Transactions on Visualization and Computer Graphics
Cardiogram: visual analytics for automotive engineers
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Information visualization evaluation in large companies: challenges, experiences and recommendations
Information Visualization - Special issue on Evaluation for Information Visualization
| Hi-index | 0.00 |
We examine the process and some implications of evaluating information visualization in a large company setting. While several researchers have addressed the difficulties of evaluating information visualizations with regards to changing data, tasks, and visual encodings, considerably less work has been published on the difficulties of evaluation within specific work contexts. In this paper, we specifically focus on the challenges arising in the context of large companies with several thousand employees. We present a collection of evaluation challenges, discuss our own experiences conducting information visualization evaluation within the context of a large automotive company, and present a set of recommendations derived from our experiences. The set of challenges and recommendations can aid researchers and practitioners in preparing and conducting evaluations of their products within a large company setting.