Dynamic balance of a biped robot using fuzzy reinforcement learning agents

  • Authors:
  • Changjiu Zhou;Qingchun Meng

  • Affiliations:
  • School of Electrical and Electronic Engineering, Singapore Polytechnic, 500 Dover Road, Singapore 139651, Singapore;Department of Electronic Engineering, Ocean University of Qingdao, Qingdao, People's Republic of China

  • Venue:
  • Fuzzy Sets and Systems - Special issue: Fuzzy set techniques for intelligent robotic systems
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a general fuzzy reinforcement learning (FRL) method for biped dynamic balance control. Based on a neuro fuzzy network architecture, different kinds of expert knowledge and measurement-based information can be incorporated into the FRL agent to initialise its action network, critic network and/or evaluation feedback module so as to aecelerate its learning. The proposed FRL agent is constructed and verified using the simulation model of a physical biped robot. The sinmtation analysis shows that by incorporation of the human intuitive balancing knowledge and walking evaluation knowledge, the FRL agent's learning rate for side-to-side and front-to-back balance of the simulated biped can be improved. We also demonstrate that it is possible for a biped robot to start its walking with a priori knowledge and then learn to improve its behaviour with the FRL agents.