Analyzing analytics

  • Authors:
  • Rajesh Bordawekar;Bob Blainey;Chidanand Apte

  • Affiliations:
  • IBM Watson Research Center, Yorktown Heights, NY;IBM Toronto Software Lab, Markham, Ontario;IBM Watson Research Center, Yorktown Heights, NY

  • Venue:
  • ACM SIGMOD Record
  • Year:
  • 2014

Quantified Score

Hi-index 0.00

Visualization

Abstract

Many organizations today are faced with the challenge of processing and distilling information from huge and growing collections of data. Such organizations are increasingly deploying sophisticated mathematical algorithms to model the behavior of their business processes to discover correlations in the data, to predict trends and ultimately drive decisions to optimize their operations. These techniques, are known collectively as analytics, and draw upon multiple disciplines, including statistics, quantitative analysis, data mining, and machine learning. In this survey paper, we identify some of the key techniques employed in analytics both to serve as an introduction for the non-specialist and to explore the opportunity for greater optimizations for parallelization and acceleration using commodity and specialized multi-core processors. We are interested in isolating and documenting repeated patterns in analytical algorithms, data structures and data types, and in understanding howthese could be most effectively mapped onto parallel infrastructure. To this end, we focus on analytical models that can be executed using different algorithms. For most major model types, we study implementations of key algorithms to determine common computational and runtime patterns. We then use this information to characterize and recommend suitable parallelization strategies for these algorithms, specifically when used in data management workloads.