Belief revision with reinforcement learning for interactive object recognition

Authors:
Thomas Leopold;Gabriele Kern-Isberner;Gabriele Peters
Affiliations:
University of Technology Dortmund, Germany, email: thleopold@hotmail.com;University of Technology Dortmund, Germany, email: gabriele.kern-isberner@cs.uni-dortmund.de;University of Applied Sciences and Arts Dortmund, Germany, email: gabriele.peters@fh-dortmund.de
Venue:
Proceedings of the 2008 conference on ECAI 2008: 18th European Conference on Artificial Intelligence
Year:
2008

Citing 5
Cited 0

Reinforcement Learning

Reinforcement Learning
The Architecture of Cognition

The Architecture of Cognition
2007 Special Issue: The interaction of implicit learning, explicit hypothesis testing learning and implicit-to-explicit knowledge extraction

Neural Networks
Conditionals in nonmonotonic reasoning and belief revision: considering conditionals as agents

Conditionals in nonmonotonic reasoning and belief revision: considering conditionals as agents
A fuzzy controller with supervised learning assisted reinforcement learning algorithm for obstacle avoidance

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Quantified Score

Hi-index	0.00

Visualization

Abstract

From a conceptual point of view, belief revision and learning are quite similar. Both methods change the belief state of an intelligent agent by processing incoming information. However, for learning, the focus in on the exploitation of data to extract and assimilate useful knowledge, whereas belief revision is more concerned with the adaption of prior beliefs to new information for the purpose of reasoning. In this paper, we propose a hybrid learning method called SPHINX that combines low-level, non-cognitive reinforcement learning with high-level epistemic belief revision, similar to human learning. The former represents knowledge in a sub-symbolic, numerical way, while the latter is based on symbolic, non-monotonic logics and allows reasoning. Beyond the theoretical appeal of linking methods of very different disciplines of artificial intelligence, we will illustrate the usefulness of our approach by employing SPHINX in the area of computer vision for object recognition tasks. The SPHINX agent interacts with its environment by rotating objects depending on past experiences and newly acquired generic knowledge to choose those views which are most advantageous for recognition.