Robot Control Optimization Using Reinforcement Learning

  • Authors:
  • Kai-Tai Song;Wen-Yu Sun

  • Affiliations:
  • Department of Control Engineering, National Chiao Tung University, 1001 Ta Hsueh Road, Hsinchu 300, Taiwan, R.O.C./ e-mail: ktsong@cc.nctu.edu.tw;Department of Control Engineering, National Chiao Tung University, 1001 Ta Hsueh Road, Hsinchu 300, Taiwan, R.O.C./ e-mail: ktsong@cc.nctu.edu.tw

  • Venue:
  • Journal of Intelligent and Robotic Systems
  • Year:
  • 1998

Quantified Score

Hi-index 0.00

Visualization

Abstract

Conventional robot control schemes are basically model-based methods.However, exact modeling of robot dynamics poses considerable problems andfaces various uncertainties in task execution. This paper proposes areinforcement learning control approach for overcoming such drawbacks. Anartificial neural network (ANN) serves as the learning structure, and anapplied stochastic real-valued (SRV) unit as the learning method. Initially,force tracking control of a two-link robot arm is simulated to verify thecontrol design. The simulation results confirm that even without informationrelated to the robot dynamic model and environment states, operation rulesfor simultaneous controlling force and velocity are achievable by repetitiveexploration. Hitherto, however, an acceptable performance has demanded manylearning iterations and the learning speed proved too slow for practicalapplications. The approach herein, therefore, improves the trackingperformance by combining a conventional controller with a reinforcementlearning strategy. Experimental results demonstrate improved trajectorytracking performance of a two-link direct-drive robot manipulator using theproposed method.