Entropy, Combinatorial Dimensions and Random Averages

  • Authors:
  • Shahar Mendelson;Roman Vershynin

  • Affiliations:
  • -;-

  • Venue:
  • COLT '02 Proceedings of the 15th Annual Conference on Computational Learning Theory
  • Year:
  • 2002

Quantified Score

Hi-index 0.01

Visualization

Abstract

In this article we introduce a new combinatorial parameter which generalizes the VC dimension and the fat-shattering dimension, and extends beyond the function-class setup. Using this parameter we establish entropy bounds for subsets of the n-dimensional unit cube, and in particular, we present new bounds on the empirical covering numbers and gaussian averages associated with classes of functions in terms of the fat-shattering dimension.