Future prediction with hierarchical episodic memories under deterministic and stochastic environments

  • Authors:
  • Yoshito Aota;Yoshihiro Miyake

  • Affiliations:
  • Tokyo Institute of Technology, Tokyo, Japan,Yokohama National University, Yokohama, Japan;Tokyo Institute of Technology, Tokyo, Japan

  • Venue:
  • ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part I
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

In agreement with Bond's suggestion, we consider that episodic memories are hierarchized autonomously by simple rule. In this research, our model solves maze tasks. Each episodic memory corresponds to the model's each track. In our previous research, we suggested that our model concatenates episodic memories into one long episodic memory. Our previous model showed successful prediction of any long periodical and deterministic environmental changes with editing (selecting and concatenating with adequate timing) stored episodic memories autonomously. However, the previous models could not select adequate actions under a stochastic environment like POMDPs. Here, we suggest hierarchical episodic memories implement into the model. It is shown that the model improved not only their action under POMDPs but also prediction of long-term environmental change and incremental learning.