Small and stable descriptors of distributions for geometric statistical problems

  • Authors:
  • Pankaj K. Agarwal;Jeff M. Phillips

  • Affiliations:
  • Duke University;Duke University

  • Venue:
  • Small and stable descriptors of distributions for geometric statistical problems
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This thesis explores how to sparsely represent distributions of points for geometric statistical problems. A coreset C is a small summary of a point set P such that if a certain statistic is computed on P and C, then the difference in the results is guaranteed to be bounded by a parameter &egr;. Two examples of coresets are &egr;-samples and &egr;-kernels. An &egr;-sample can estimate the density of a point set in any range from a geometric family of ranges (e.g., disks, axis-aligned rectangles). An &egr;-kernel approximates the width of a point set in all directions. Both coresets have size that depends only on &egr;, the error parameter, not the size of the original data set. We demonstrate several improvements to these coresets and how they are useful for geometric statistical problems. We reduce the size of &egr;-samples for density queries in axis-aligned rectangles to nearly a square root of the size when the queries are with respect to more general families of shapes, such as disks. We also show how to construct &egr;-samples of probability distributions. We show how to maintain "stable" &egr;-kernels, that is, if the point set P changes by a small amount, then the &egr;-kernel also changes by a small amount. This is useful in surveillance and tracking problems, and the stable properties leads to more efficient algorithms for maintaining &egr;-kernels. We next study when the input point sets are uncertain and their uncertainty is modeled by probability distributions. Statistics on these point sets (e.g., radius of smallest enclosing ball) do not have exact answers, but rather distributions of answers. We describe data structures to represent approximations of these distributions and algorithms to compute them. We also show how to create distributions of &egr;-kernels and &egr;-samples for these uncertain data sets. Finally, we examine a spatial anomaly detection problem: computing a spatial scan statistic. The input is a point set P and measurements on the point set. The spatial scan statistic finds the range (e.g., an axis-aligned bounding box) where the measurements inside the range are the most different from measurements outside of the range. We show how to compute this statistic efficiently while allowing for a bounded amount of approximation error. This result generalizes to several statistical models and types of input point sets.