Multi-Agent cooperative reinforcement learning in 3d virtual world

  • Authors:
  • Ping Zhang;Xiujun Ma;Zijian Pan;Xiong Li;Kunqing Xie

  • Affiliations:
  • Key Laboratory of Machine Perception (Minister of Education), Peking University, Beijing, China;Key Laboratory of Machine Perception (Minister of Education), Peking University, Beijing, China;Key Laboratory of Machine Perception (Minister of Education), Peking University, Beijing, China;Key Laboratory of Machine Perception (Minister of Education), Peking University, Beijing, China;Key Laboratory of Machine Perception (Minister of Education), Peking University, Beijing, China

  • Venue:
  • ICSI'10 Proceedings of the First international conference on Advances in Swarm Intelligence - Volume Part I
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

A virtual world is an online community in the form of a computer-based simulated environment, through which users can interact with one another and use and create objects The non-player characters (NPC) in virtual world are following a fixed set of pre-programmed behaviors and lack the ability to adapt with the changing surrounding Reinforcement learning agent is a way to deal with this problem However, in a cooperative social environment, NPC should learn not only by trial and error, but also through cooperation by sharing information The key investigation of this paper is: modeling the NPCs as multi-agent, and enable them to conduct cooperative learning, then speeding up the learning process By using a fire fighting scenario in Robocup Rescue, our research shows that sharing information between cooperative agents will outperform independent agents who do not communicate during learning The further work and some important issues of multi-agent reinforcement learning in virtual world will also be discussed in this paper.