Construction of an Internal Predictive Model by Event Anticipation

  • Authors:
  • Philippe Capdepuy;Daniel Polani;Chrystopher L. Nehaniv

  • Affiliations:
  • Adaptive Systems, School of Computer Science, University of Hertfordshire, College Lane, Hatfield, Herts, AL10 9AB, UK;Adaptive Systems, School of Computer Science, University of Hertfordshire, College Lane, Hatfield, Herts, AL10 9AB, UK and Algorithms Research Groups, School of Computer Science, University of Her ...;Adaptive Systems, School of Computer Science, University of Hertfordshire, College Lane, Hatfield, Herts, AL10 9AB, UK and Algorithms Research Groups, School of Computer Science, University of Her ...

  • Venue:
  • Anticipatory Behavior in Adaptive Learning Systems
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

We introduce information-theoretic tools that can be used in an autonomous agent for constructing an internal predictive model based on event anticipation. This model relies on two different kinds of predictive relationships: time-delay relationships, where two events are related by a nearly constant time-delay between their occurrences; and contingency relationships, where proximity in time is the main property. We propose an anticipation architecture based on these tools that allows the construction of a relevant internal model of the environment through experience. Its design takes into account the problem of handling different time scales. We illustrate the effectiveness of the tools proposed with preliminary results about their ability to identify relevant relationships in different conditions. We describe how these principles can be embedded in a more complex architecture that allows action-decision making according to reward expectation, and handling of more complex relationships. We conclude by discussing issues that were not addressed yet and some axis for future investigations.