Can finite samples detect singularities of real-valued functions?

  • Authors:
  • Shai Ben-David

  • Affiliations:
  • Dept. of Computer Science, Technion, Haifa 32000, Israel

  • Venue:
  • STOC '92 Proceedings of the twenty-fourth annual ACM symposium on Theory of computing
  • Year:
  • 1992

Quantified Score

Hi-index 0.00

Visualization

Abstract

Consider the following type of problem: There is an unknown function, f : Rn → Rm, there is also a black-box that on query x (&egr; Rn) returns f(x). Is there an algorithm that, using probes to the black-box, can figure out analytic information about f? (For an example: “Is f a polynomial?”, “Is f a second order differentiable at x = (0,0,…,0)?” etc.).Clearly, for examples as these, if we bound the number of probes an algorithm has to settle for, no algorithm can carry the task. On the other hand, if one allows an infinite iteration of a “probe compute and guess” process, then, (quite surprisingly) for many such questions, there are algorithms that are guaranteed to be correct in all but finitely many of their guesses. We call such questions Decidable In the Limit, (DIL).We analyze the class of DIL problems and provide a necessary and sufficient condition for the membership of a decision problem in this class. We offer an algorithm for any DIL problem, and apply it to several types of learning tasks.Furthermore, if an a-priori probability distribution P, according to which f is being chosen, is available to the algorithm, then it can be strengthened into a finite algorithm. More precisely, for many distributions P, there exists a polynomial function, l, such that for every 0l(log(&dgr;)) many probes that succeeds on more than (1–&dgr;) of the f's (as measured by P).We believe that the new approach presented here will be found useful for many further applications.