Reinforcement learning for quasi-passive dynamic walking of an unstable biped robot

Authors:
Kentarou Hitomi;Tomohiro Shibata;Yutaka Nakamura;Shin Ishii
Affiliations:
Graduate School of Information Science, Nara Institute of Science and Technology, 8916-5 Takayama, Ikoma, Nara 630-0192, Japan;Graduate School of Information Science, Nara Institute of Science and Technology, 8916-5 Takayama, Ikoma, Nara 630-0192, Japan;Graduate School of Information Science, Nara Institute of Science and Technology, 8916-5 Takayama, Ikoma, Nara 630-0192, Japan;Graduate School of Information Science, Nara Institute of Science and Technology, 8916-5 Takayama, Ikoma, Nara 630-0192, Japan
Venue:
Robotics and Autonomous Systems
Year:
2006

Citing 2
Cited 2

Passive dynamic walking

International Journal of Robotics Research
An Analysis of Actor/Critic Algorithms Using Eligibility Traces: Reinforcement Learning with Imperfect Value Function

ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning

Acquisition of energy-efficient bipedal walking using CPG-based reinforcement learning

IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems
Fuzzy SVM learning control system considering time properties of biped walking samples

Engineering Applications of Artificial Intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

A class of biped locomotion called Passive Dynamic Walking (PDW) has been recognized to be efficient in energy consumption and a key to understand human walking. Although PDW is sensitive to the initial condition and disturbances, studies of Quasi-PDW which incorporates supplemental actuators have been reported to overcome this sensitivity. In this article, we propose a reinforcement learning method designed particularly for Quasi-PDW of a biped robot whose possession of knees makes the system unstable. Simulations show that the learning is quickly accomplished after 1000 episodes, and the obtained controller is robust against variations in the slope gradient and sudden perturbations.