An O(nlog log n) learning algorithm for DNF under the uniform distribution

  • Authors:
  • Yishay Mansour

  • Affiliations:
  • IBM - Thomas J. Watson Research Center., P. O. Box 704, Yorktown Heights, New York

  • Venue:
  • COLT '92 Proceedings of the fifth annual workshop on Computational learning theory
  • Year:
  • 1992

Quantified Score

Hi-index 0.00

Visualization

Abstract

We show that a DNF with terms of size at most d can be approximated by a function with at most dO(d log 1/&egr;))non zero Fourier coefficients such that the expected error squared, with respect to the uniform distribution, is at most &egr;. This property is used to derive a learning algorithm for DNF, under the uniform distribution.The learning algorithm uses queries and learns, with respect to the uniform distribution, a DNF with terms of size at most d in time polynomial in n and dO(d log 1/egr;). The interesting implications are for the case when &egr; is constant. In this case our algorithm learns a DNF with a polynomial number of terms in time nO(log log n), and a DNF with terms of size at most O(log n/log log n) in polynomial time.