Learning from observation using primitives

  • Authors:
  • Darrin C. Bentivegna;Christopher G. Atkeson

  • Affiliations:
  • -;-

  • Venue:
  • Learning from observation using primitives
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Learning without any prior knowledge in environments that contain large or continuous state spaces is a daunting task. For robots that operate in the real world, learning must occur in a reasonable amount of time. Providing a robot with domain knowledge and also with the ability to learn from watching other can greatly increase its learning rate. This research seeks to explore learning algorithms that can learn quickly and make the most use of information obtained from observing others. Domain knowledge is encoded in the form of primitives, small parts of a task that are executed many times while a task is being performed. This thesis explores and presents difficulties involved in getting robots to learn and adapt to environments that humans operate in. Virtual and real-world environments of air hockey and the marble maze game have been created as test-beds for this research. A humanoid robot has been programmed to operate in the air hockey environment and a Labyrinth game has been equipped with motors and sensors to allow it to be controlled by a computer. A “Learning from Observation Using Primitives” framework has been created. This framework provides the means to observe primitives as they are performed by others. This information is then used by the robot in a three-level process as it performs in the environment. Our initial research has shown that using only observed information leads to varying degrees of success. Therefore, the robot must have the ability to learn from practice while operating in the environment. Our framework provides a means for the robot to observe and evaluate its own actions as it performs in the environment. This information can then be used to increase the performance of selecting and performing the primitives.