Real-Time decision making for large POMDPs

Authors:
Sébastien Paquet;Ludovic Tobin;Brahim Chaib-draa
Affiliations:
DAMAS Laboratory, Department of Computer Science and Software Engineering, Laval University;DAMAS Laboratory, Department of Computer Science and Software Engineering, Laval University;DAMAS Laboratory, Department of Computer Science and Software Engineering, Laval University
Venue:
AI'05 Proceedings of the 18th Canadian Society conference on Advances in Artificial Intelligence
Year:
2005

Citing 4
Cited 5

Heuristic search value iteration for POMDPs

UAI '04 Proceedings of the 20th conference on Uncertainty in artificial intelligence
Exploiting structure to efficiently solve large scale partially observable markov decision processes

Exploiting structure to efficiently solve large scale partially observable markov decision processes
Stochastic local search for POMDP controllers

AAAI'04 Proceedings of the 19th national conference on Artifical intelligence
Point-based value iteration: an anytime algorithm for POMDPs

IJCAI'03 Proceedings of the 18th international joint conference on Artificial intelligence

Scaling up: solving POMDPs through value based clustering

AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 2
Performance analysis of online anticipatory algorithms for large multistage stochastic integer programs

IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Aircraft Collision Avoidance Using Monte Carlo Real-Time Belief Space Search

Journal of Intelligent and Robotic Systems
Prioritizing point-based POMDP solvers

ECML'06 Proceedings of the 17th European conference on Machine Learning
Active exploration for robust object detection

IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Three

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we introduce an approach called RTBSS (Real-Time Belief Space Search) for real-time decision making in large POMDPs The approach is based on a look-ahead search that is applied online each time the agent has to make a decision RTBSS is particularly interesting for large real-time environments where offline solutions are not applicable because of their complexity.