Generalization bounds of ERM algorithm with V-geometrically Ergodic Markov chains

  • Authors:
  • Bin Zou;Zongben Xu;Xiangyu Chang

  • Affiliations:
  • Faculty of Mathematics and Computer Science, Hubei University, Wuhan, China 430062 and Institute for Information and System Science, Faculty of Science, Xi'an Jiaotong University, Xi'an, China 710 ...;Institute for Information and System Science, Faculty of Science, Xi'an Jiaotong University, Xi'an, China 710049;Institute for Information and System Science, Faculty of Science, Xi'an Jiaotong University, Xi'an, China 710049

  • Venue:
  • Advances in Computational Mathematics
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

The previous results describing the generalization ability of Empirical Risk Minimization (ERM) algorithm are usually based on the assumption of independent and identically distributed (i.i.d.) samples. In this paper we go far beyond this classical framework by establishing the first exponential bound on the rate of uniform convergence of the ERM algorithm with V-geometrically ergodic Markov chain samples, as the application of the bound on the rate of uniform convergence, we also obtain the generalization bounds of the ERM algorithm with V-geometrically ergodic Markov chain samples and prove that the ERM algorithm with V-geometrically ergodic Markov chain samples is consistent. The main results obtained in this paper extend the previously known results of i.i.d. observations to the case of V-geometrically ergodic Markov chain samples.