On the mutual nearest neighbors estimate in regression

  • Authors:
  • Arnaud Guyader;Nick Hengartner

  • Affiliations:
  • Université Rennes 2, IRMAR & INRIA Rennes, Rennes Cedex, France;Information Sciences Group, Los Alamos National Laboratory, Los Alamos, NM

  • Venue:
  • The Journal of Machine Learning Research
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Motivated by promising experimental results, this paper investigates the theoretical properties of a recently proposed nonparametric estimator, called the Mutual Nearest Neighbors rule, which estimates the regression function m(x) = E[Y|X = x] as follows: first identify the k nearest neighbors of x in the sample Dn, then keep only those for which x is itself one of the k nearest neighbors, and finally take the average over the corresponding response variables. We prove that this estimator is consistent and that its rate of convergence is optimal. Since the estimate with the optimal rate of convergence depends on the unknown distribution of the observations, we also present adaptation results by data-splitting.