TREC: Continuing information retrieval's tradition of experimentation
Communications of the ACM
Promoting Insight-Based Evaluation of Visualizations: From Contest to Benchmark Repository
IEEE Transactions on Visualization and Computer Graphics
Proceedings of the 2008 Workshop on BEyond time and errors: novel evaLuation methods for Information Visualization
Evaluating Visual Analytics at the 2007 VAST Symposium Contest
IEEE Computer Graphics and Applications
VAST 2007 Contest - Blue Iguanodon
VAST '07 Proceedings of the 2007 IEEE Symposium on Visual Analytics Science and Technology
Developing guidelines for assessing visual analytics environments
Information Visualization - Special issue on Evaluation for Information Visualization
Information Visualization - Special issue on State of the Field and New Research Directions
A reflection on seven years of the VAST challenge
Proceedings of the 2012 BELIV Workshop: Beyond Time and Errors - Novel Evaluation Methods for Visualization
Hi-index | 0.00 |
In this paper, the authors describe the Visual Analytics Science and Technology (VAST) Symposium contests run in 2006 and 2007 and the VAST 2008 and 2009 challenges. These contests were designed to provide researchers with a better understanding of the tasks and data that face potential end users. Access to these end users is limited because of time constraints and the classified nature of the tasks and data. In that respect, the contests serve as an intermediary, with the metrics and feedback serving as measures of utility to the end users. The authors summarize the lessons learned and the future directions for VAST Challenges.