Threat stream data generator: creating the known unknowns for test and evaluation of visual analytics tools

  • Authors:

  • Mark A. Whiting;Wendy Cowley;Jereme Haack;Doug Love;Stephen Tratz;Caroline Varley;Kim Wiessner

  • Affiliations:

  • Pacific Northwest National Laboratory, Richland, WA;Pacific Northwest National Laboratory, Richland, WA;Pacific Northwest National Laboratory, Richland, WA;Pacific Northwest National Laboratory, Richland, WA;Pacific Northwest National Laboratory, Richland, WA;Pacific Northwest National Laboratory, Richland, WA;Pacific Northwest National Laboratory, Richland, WA

  • Venue:
  • Proceedings of the 2006 AVI workshop on BEyond time and errors: novel evaluation methods for information visualization
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present the Threat Stream Data Generator, an approach and tool for creating synthetic data sets for the test and evaluation of visual analytics tools and environments. We have focused on working with information analysts to understand the characteristics of threat data, to develop scenarios that will allow us to define data sets with known ground truth, to define a process of mapping threat elements in a scenario to expressions in data, and creating a software system to generate the data. We are also developing approaches to evaluating our data sets considering characteristics such as threat subtlety and appropriateness of data for the software to be examined.