Learning from uniformly ergodic Markov chains

  • Authors:
  • Bin Zou;Hai Zhang;Zongben Xu

  • Affiliations:
  • Institute for Information and System Science, Faculty of Science, Xi'an Jiaotong University, Xi'an, 710049, PR China and Faculty of Mathematics and Computer Science, Hubei University, Wuhan, 43006 ...;Institute for Information and System Science, Faculty of Science, Xi'an Jiaotong University, Xi'an, 710049, PR China;Institute for Information and System Science, Faculty of Science, Xi'an Jiaotong University, Xi'an, 710049, PR China

  • Venue:
  • Journal of Complexity
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Evaluation for generalization performance of learning algorithms has been the main thread of machine learning theoretical research. The previous bounds describing the generalization performance of the empirical risk minimization (ERM) algorithm are usually established based on independent and identically distributed (i.i.d.) samples. In this paper we go far beyond this classical framework by establishing the generalization bounds of the ERM algorithm with uniformly ergodic Markov chain (u.e.M.c.) samples. We prove the bounds on the rate of uniform convergence/relative uniform convergence of the ERM algorithm with u.e.M.c. samples, and show that the ERM algorithm with u.e.M.c. samples is consistent. The established theory underlies application of ERM type of learning algorithms.