Network Traffic Analysis With Query Driven Visualization SC 2005 HPC Analytics Results

  • Authors:
  • Kurt Stockinger;Kesheng Wu;Scott Campbell;Stephen Lau;Mike Fisk;Eugene Gavrilov;Alex Kent;Christopher E. Davis;Rick Olinger;Rob Young;Jim Prewett;Paul Weber;Thomas P. Caudell;E. Wes Bethel;Steve Smith

  • Affiliations:
  • High Performance Computing Research Department (HPCRD/LBNL);High Performance Computing Research Department (HPCRD/LBNL);National Energy Research Sciences Center (NERSC/LBNL);National Energy Research Sciences Center (NERSC/LBNL);Los Alamos National Laboratory (LANL);Los Alamos National Laboratory (LANL);Los Alamos National Laboratory (LANL);University of New Mexico (UNM);University of New Mexico (UNM);University of New Mexico (UNM);University of New Mexico (UNM);Los Alamos National Laboratory (LANL);Los Alamos National Laboratory (LANL);High Performance Computing Research Department (HPCRD/LBNL;Los Alamos National Laboratory (LANL)

  • Venue:
  • SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Our analytics task is to identify, characterize, and visualize anomalous subsets of as large of a collection of network connection data as possible. We use a combination of HPC resources, advanced algorithms, and visualization techniques. To effectively and efficiently identify the salient portions of the data, we rely on a multistage workflow that includes data acquisition, summarization (feature extraction), novelty detection, and classification. Once these subsets of interest have been identified and automatically characterized, we use a stateof- the-art high-dimensional query system to extract this data for interactive visualization. Our approach is equally useful for other large-data analysis problems where it is more practical to identify interesting subsets of the data for visualization than it is to render all data elements. By reducing the size of the rendering workload, we enable highly interactive and useful visualizations.