The elements of graphing data
Automating the design of graphical presentations of relational information
ACM Transactions on Graphics (TOG)
The visual display of quantitative information
The visual display of quantitative information
Developing user interfaces: ensuring usability through product & process
Developing user interfaces: ensuring usability through product & process
Finding usability problems through heuristic evaluation
CHI '92 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A field study of exploratory learning strategies
ACM Transactions on Computer-Human Interaction (TOCHI)
Readings in information visualization: using vision to think
Readings in information visualization: using vision to think
Empirical evaluation of information visualizations: an introduction
International Journal of Human-Computer Studies - Empirical evaluation of information visualizations
Empirical studies of information visualization: a meta-analysis
International Journal of Human-Computer Studies - Empirical evaluation of information visualizations
Diagramming information structures using 3D perceptual primitives
ACM Transactions on Computer-Human Interaction (TOCHI)
The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations
VL '96 Proceedings of the 1996 IEEE Symposium on Visual Languages
An Empirical Comparison of Three Commercial Information Visualization Systems
INFOVIS '01 Proceedings of the IEEE Symposium on Information Visualization 2001 (INFOVIS'01)
CAEVA: Cognitive Architecture to Evaluate Visualization Applications
IV '03 Proceedings of the Seventh International Conference on Information Visualization
Information Visualization: Perception for Design
Information Visualization: Perception for Design
The challenge of information visualization evaluation
Proceedings of the working conference on Advanced visual interfaces
An Evaluation of Microarray Visualization Tools for Biological Insight
INFOVIS '04 Proceedings of the IEEE Symposium on Information Visualization
INFOVIS '04 Proceedings of the IEEE Symposium on Information Visualization
Visualizing biological pathways: requirements analysis, systems evaluation and research agenda
Information Visualization - Special issue: Bioinformatics visualization
Dynamic querying for pattern identification in microarray and genomic data
ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 3 (ICME '03) - Volume 03
On evaluating information visualization techniques
Proceedings of the Working Conference on Advanced Visual Interfaces
IEEE Transactions on Visualization and Computer Graphics
Toward Measuring Visualization Insight
IEEE Computer Graphics and Applications
Visualizing biological pathways: requirements analysis, systems evaluation and research agenda
Information Visualization - Special issue: Bioinformatics visualization
Methods for the evaluation of an interactive InfoVis tool supporting exploratory reasoning processes
Proceedings of the 2006 AVI workshop on BEyond time and errors: novel evaluation methods for information visualization
An Insight-Based Longitudinal Study of Visual Analytics
IEEE Transactions on Visualization and Computer Graphics
Move to improve: promoting physical navigation to increase user performance with large displays
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Visual Analytics: Realizing embodied interaction for visual analytics through large displays
Computers and Graphics
Casual Information Visualization: Depictions of Data in Everyday Life
IEEE Transactions on Visualization and Computer Graphics
Extreme visualization: squeezing a billion records into a million pixels
Proceedings of the 2008 ACM SIGMOD international conference on Management of data
Proceedings of the 2008 Workshop on BEyond time and errors: novel evaLuation methods for Information Visualization
Internalization, qualitative methods, and evaluation
Proceedings of the 2008 Workshop on BEyond time and errors: novel evaLuation methods for Information Visualization
Grounded evaluation of information visualizations
Proceedings of the 2008 Workshop on BEyond time and errors: novel evaLuation methods for Information Visualization
Qualitative analysis of visualization: a building design field study
Proceedings of the 2008 Workshop on BEyond time and errors: novel evaLuation methods for Information Visualization
Using multi-dimensional in-depth long-term case studies for information visualization evaluation
Proceedings of the 2008 Workshop on BEyond time and errors: novel evaLuation methods for Information Visualization
Evaluating Information Visualizations
Information Visualization
Creation and Collaboration: Engaging New Audiences for Information Visualization
Information Visualization
Visualizations at First Sight: Do Insights Require Training?
USAB '08 Proceedings of the 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society on HCI and Usability for Education and Work
Proceedings of the ACM 2009 international conference on Supporting group work
Visual data mining of multimedia data for social and behavioral studies
Information Visualization
Visual overviews for discovering key papers and influences across research fronts
Journal of the American Society for Information Science and Technology
Defining insight for visual analytics
IEEE Computer Graphics and Applications - Special issue title on demystifying visual analytics impaired driving in virtual spaces
To score or not to score? tripling insights for participatory design
IEEE Computer Graphics and Applications - Special issue on sketching tangible interfaces augmented reality on mobile phones
G-nome surfer: a tabletop interface for collaborative exploration of genomic data
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Mixing evaluation methods for assessing the utility of an interactive InfoVis technique
HCI'07 Proceedings of the 12th international conference on Human-computer interaction: interaction design and usability
Measuring effective data visualization
ISVC'07 Proceedings of the 3rd international conference on Advances in visual computing - Volume Part II
Video games for collection exploration: games for and out of data repositories
Proceedings of the 14th International Academic MindTrek Conference: Envisioning Future Media Environments
Mapping the users'problem solving strategies in the participatory design of visual analytics methods
USAB'10 Proceedings of the 6th international conference on HCI in work and learning, life and leisure: workgroup human-computer interaction and usability engineering
Playable data: characterizing the design space of game-y infographics
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Enhancing genomic learning through tabletop interaction
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The personal equation of complex individual cognition during visual interface interaction
HCIV'09 Proceedings of the Second IFIP WG 13.7 conference on Human-computer interaction and visualization
Using gaze data in evaluating interactive visualizations
HCIV'09 Proceedings of the Second IFIP WG 13.7 conference on Human-computer interaction and visualization
Human-centered visualization environments
Human-centered visualization environments
Many roads lead to Rome: mapping users' problem solving strategies
Proceedings of the 3rd BELIV'10 Workshop: BEyond time and errors: novel evaLuation methods for Information Visualization
Exploring information visualization: describing different interaction patterns
Proceedings of the 3rd BELIV'10 Workshop: BEyond time and errors: novel evaLuation methods for Information Visualization
Learning-based evaluation of visual analytic systems
Proceedings of the 3rd BELIV'10 Workshop: BEyond time and errors: novel evaLuation methods for Information Visualization
Is your user hunting or gathering insights?: identifying insight drivers across domains
Proceedings of the 3rd BELIV'10 Workshop: BEyond time and errors: novel evaLuation methods for Information Visualization
Comparing benchmark task and insight evaluation methods on timeseries graph visualizations
Proceedings of the 3rd BELIV'10 Workshop: BEyond time and errors: novel evaLuation methods for Information Visualization
Evaluating information visualization in large companies: challenges, experiences and recommendations
Proceedings of the 3rd BELIV'10 Workshop: BEyond time and errors: novel evaLuation methods for Information Visualization
Sequential patterns mining and gene sequence visualization to discover novelty from microarray data
Journal of Biomedical Informatics
A comparison of benchmark task and insight evaluation methods for information visualization
Information Visualization - Special issue on Evaluation for Information Visualization
Many roads lead to Rome: mapping users' problem-solving strategies
Information Visualization - Special issue on Evaluation for Information Visualization
Information visualization evaluation in large companies: challenges, experiences and recommendations
Information Visualization - Special issue on Evaluation for Information Visualization
Collaborative visualization: definition, challenges, and research agenda
Information Visualization - Special issue on State of the Field and New Research Directions
International Journal of Human-Computer Studies
Dual analysis of DNA microarrays
Proceedings of the 12th International Conference on Knowledge Management and Knowledge Technologies
JVRC'09 Proceedings of the 15th Joint virtual reality Eurographics conference on Virtual Environments
Journal of the American Society for Information Science and Technology
Pathline: a tool for comparative functional genomics
EuroVis'10 Proceedings of the 12th Eurographics / IEEE - VGTC conference on Visualization
Proceedings of the 2012 BELIV Workshop: Beyond Time and Errors - Novel Evaluation Methods for Visualization
From big data to insights: opportunities and challenges for TEI in genomics
Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction
Recommender narrative visualization
CASCON '13 Proceedings of the 2013 Conference of the Center for Advanced Studies on Collaborative Research
Proceedings of the 19th international conference on Intelligent User Interfaces
Visualizing protected variations in evolving software designs
Journal of Systems and Software
Evolutionary visual exploration: evaluation with expert users
EuroVis '13 Proceedings of the 15th Eurographics Conference on Visualization
Hi-index | 0.01 |
High-throughput experiments, such as gene expression microarrays in the life sciences, result in very large data sets. In response, a wide variety of visualization tools have been created to facilitate data analysis. A primary purpose of these tools is to provide biologically relevant insight into the data. Typically, visualizations are evaluated in controlled studies that measure user performance on predetermined tasks or using heuristics and expert reviews. To evaluate and rank bioinformatics visualizations based on real-world data analysis scenarios, we developed a more relevant evaluation method that focuses on data insight. This paper presents several characteristics of insight that enabled us to recognize and quantify it in open-ended user tests. Using these characteristics, we evaluated five microarray visualization tools on the amount and types of insight they provide and the time it takes to acquire it. The results of the study guide biologists in selecting a visualization tool based on the type of their microarray data, visualization designers on the key role of user interaction techniques, and evaluators on a new approach for evaluating the effectiveness of visualizations for providing insight. Though we used the method to analyze bioinformatics visualizations, it can be applied to other domains.