Linear vs. nonlinear algorithms for linear problems

  • Authors:
  • Jakob Creutzig;P. Wojtaszczyk

  • Affiliations:
  • Department of Mathematics, Informatics and Mechanics, Warsaw University, ul Banacha 2, 02-097 Warszawa, Poland;Department of Mathematics, Informatics and Mechanics, Warsaw University, ul Banacha 2, 02-097 Warszawa, Poland

  • Venue:
  • Journal of Complexity
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

We compare linear and non-linear approximations for linear problems. Let X be a linear space and Y a normed space. Let S : X → Y and N : X → Rn be linear mappings and consider the worst-case setting over some balanced convex set F ⊆ X. We compare the minimal error errlin (S, N) achievable by linear algorithms processing N with the minimal error errlin(S, N) achievable by arbitrary algorithms using N. For bounded linear problems, P. Mathé showed that infN errlin(S, N) ≤ (1 + n1/2) ċ infN err(S, N), where the infimum is taken over all bounded linear mappings N : X → Rn. We generalize this result as follows: If the target space Y is complete, then for any linear N : X → Rn. we have errlin(S, N, F) ≤ (1 +n1/2)err(S, N, F). This and some similar results can easily be derived from a general relation of this problem to extension properties of normed spaces, and the manifold and powerful results available for this problem. This allows a unified treatment of the above estimate together with the results of Smolyak and Packel, who showed that linear algorithms are optimal for some Y. The results are also partially extended to noisy information with uniformly bounded noise.