Comparing benchmark task and insight evaluation methods on timeseries graph visualizations

Authors:
Purvi Saraiya;Chris North;Karen Duca
Affiliations:
Virginia Polytechnic Institute and State University, Blacksburg, VA;Virginia Polytechnic Institute and State University, Blacksburg, VA;Virginia Polytechnic Institute and State University, Blacksburg, VA
Venue:
Proceedings of the 3rd BELIV'10 Workshop: BEyond time and errors: novel evaLuation methods for Information Visualization
Year:
2010

Citing 18
Cited 1

Usability testing vs. heuristic evaluation: was there a contest?

ACM SIGCHI Bulletin
A comparison of usability techniques for evaluating design

DIS '97 Proceedings of the 2nd conference on Designing interactive systems: processes, practices, methods, and techniques
Innovation and evaluation of information: a CHI98 workshop

ACM SIGCHI Bulletin
Empirical evaluation of information visualizations: an introduction

International Journal of Human-Computer Studies - Empirical evaluation of information visualizations
Empirical studies of information visualization: a meta-analysis

International Journal of Human-Computer Studies - Empirical evaluation of information visualizations
A comparison of usage evaluation and inspection methods for assessing groupware usability

GROUP '01 Proceedings of the 2001 International ACM SIGGROUP Conference on Supporting Group Work
User Studies: Why, How, and When?

IEEE Computer Graphics and Applications
A comparison of synchronous remote and local usability studies for an expert interface

CHI '04 Extended Abstracts on Human Factors in Computing Systems
The challenge of information visualization evaluation

Proceedings of the working conference on Advanced visual interfaces
An Insight-Based Methodology for Evaluating Bioinformatics Visualizations

IEEE Transactions on Visualization and Computer Graphics
Evaluating Visualizations: Do Expert Reviews Work?

IEEE Computer Graphics and Applications
Low-Level Components of Analytic Activity in Information Visualization

INFOVIS '05 Proceedings of the Proceedings of the 2005 IEEE Symposium on Information Visualization
Visualization of Graphs with Associated Timeseries Data

INFOVIS '05 Proceedings of the Proceedings of the 2005 IEEE Symposium on Information Visualization
Knowledge Discovery in High-Dimensional Data: Case Studies and a User Survey for the Rank-by-Feature Framework

IEEE Transactions on Visualization and Computer Graphics
Toward Measuring Visualization Insight

IEEE Computer Graphics and Applications
Visualizing biological pathways: requirements analysis, systems evaluation and research agenda

Information Visualization - Special issue: Bioinformatics visualization
Strategies for evaluating information visualization tools: multi-dimensional in-depth long-term case studies

Proceedings of the 2006 AVI workshop on BEyond time and errors: novel evaluation methods for information visualization
An Insight-Based Longitudinal Study of Visual Analytics

IEEE Transactions on Visualization and Computer Graphics

Methodologies for the analysis of usage patterns in information visualization

Proceedings of the 2012 BELIV Workshop: Beyond Time and Errors - Novel Evaluation Methods for Visualization

Quantified Score

Hi-index	0.00

Visualization

Abstract

A study to compare two different empirical research methods for evaluating visualization tools is described: the traditional benchmark-task method and the insight method. The methods were compared using different criteria such as: the conclusions about the visualization tools provided by each method, the time participants spent during the study, the time and effort required to analyze the resulting empirical data, and the effect of individual differences between participants on the results. The studies used three graph visualization alternatives to associate bioinformatics microarray timeseries data to pathway graph vertices, based on popular approaches used in existing bioinformatics software.