A simple randomized algorithm for sequential prediction of ergodic time series

  • Authors:
  • L. Gyorfi;G. Lugosi;G. Morvai

  • Affiliations:
  • Dept. of Econ., Tech. Univ. Budapest;-;-

  • Venue:
  • IEEE Transactions on Information Theory
  • Year:
  • 1999

Quantified Score

Hi-index 754.96

Visualization

Abstract

We present a simple randomized procedure for the prediction of a binary sequence. The algorithm uses ideas from previous developments of the theory of the prediction of individual sequences. We show that if the sequence is a realization of a stationary and ergodic random process then the average number of mistakes converges, almost surely, to that of the optimum, given by the Bayes predictor. The desirable finite-sample properties of the predictor are illustrated by its performance for Markov processes. In such cases the predictor exhibits near-optimal behavior even without knowing the order of the Markov process. Prediction with side information is also considered