Learning of subgoals for goal-oriented behavior control of mobile robots

Authors:
Sang Hyoung Lee;Sanghoon Lee;Il Hong Suh;Wan Kyun Chung
Affiliations:
The Department of Electronics Computer Engineering, Hanyang University, Seoul, Korea;The Department of Electronics Computer Engineering, Hanyang University, Seoul, Korea;The Department of Electronics Computer Engineering, Hanyang University, Seoul, Korea;The Department of Mechanical Engineering, POSTECH, Pohang, Korea
Venue:
ICONIP'08 Proceedings of the 15th international conference on Advances in neuro-information processing - Volume Part I
Year:
2008

Citing 5
Cited 0

Between MDPs and semi-MDPs: a framework for temporal abstraction in reinforcement learning

Artificial Intelligence
Dynamic abstraction in reinforcement learning via clustering

ICML '04 Proceedings of the twenty-first international conference on Machine learning
Subgoal Ordering and Granularity Control for Incremental Planning

ICTAI '05 Proceedings of the 17th IEEE International Conference on Tools with Artificial Intelligence
Planning Algorithms

Planning Algorithms
Acquisition of intermediate goals for an agent executing multiple tasks

IEEE Transactions on Robotics

Quantified Score

Hi-index	0.00

Visualization

Abstract

Subgoal learning is investigated to effectively build a goal-oriented behavior control rule with which a mobile robot can achieve a task goal for any starting task configurations. For this, states of interest are firstly extracted from successful task episodes, where the averaged occurrence frequency of states is used as threshold value to identify states of interest. And, subgoals are learned by clustering similar features of state transition tuples. Here, features used in clustering are produced by using changes of the states in the state transition tuples. A goal-oriented behavior control rule is made in such a way that proper actions are sequentially and/or reactively generated from the subgoal according to the context of states. To show the validities of our proposed subgoal learning as well as a goal-oriented control rule of mobile robots, a Box-Pushing-Into-a-Goal(BPIG) task is simulated and experimented.