Natural methods for robot task learning: instructive demonstrations, generalization and practice

Authors:
Monica N. Nicolescu;Maja J. Mataric
Affiliations:
University of Southern California, Los Angeles, CA;University of Southern California, Los Angeles, CA
Venue:
AAMAS '03 Proceedings of the second international joint conference on Autonomous agents and multiagent systems
Year:
2003

Citing 8
Cited 44

Local Languages, the Succesor Method, and a Step Towards a General Methodology for the Inference of Regular Grammars

IEEE Transactions on Pattern Analysis and Machine Intelligence
Introduction to algorithms

Introduction to algorithms
Inference of k-Testable Languages in the Strict Sense and Application to Syntactic Pattern Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Transfer of elementary skills via human-robot interaction

Adaptive Behavior - Special issue on environment structure and behavior
An Behavior-based Robotics

An Behavior-based Robotics
A hierarchical architecture for behavior-based robots

Proceedings of the first international joint conference on Autonomous agents and multiagent systems: part 1
Imitation as a dual-route process featuring predictive and learning components: a biologically plausible computational model

Imitation in animals and artifacts
Learning and interacting in human-robot domains

IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans

Teaching and Working with Robots as a Collaboration

AAMAS '04 Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems - Volume 3
Shaping human behavior by observing mobility gestures

Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction
A smart home agent for plan recognition

AAMAS '06 Proceedings of the fifth international joint conference on Autonomous agents and multiagent systems
Interactive robot task training through dialog and demonstration

Proceedings of the ACM/IEEE international conference on Human-robot interaction
Learning by demonstration with critique from a human teacher

Proceedings of the ACM/IEEE international conference on Human-robot interaction
Confidence-based policy learning from demonstration using Gaussian mixture models

Proceedings of the 6th international joint conference on Autonomous agents and multiagent systems
Teachable robots: Understanding human teaching behavior to build more effective robot learners

Artificial Intelligence
Multi-thresholded approach to demonstration selection for interactive robot learning

Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction
A KEYHOLE PLAN RECOGNITION MODEL FOR ALZHEIMER'S PATIENTS: FIRST RESULTS

Applied Artificial Intelligence
Teaching multi-robot coordination using demonstration of communication and state sharing

Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 3
From Abstract Task Knowledge to Executable Robot Programs

Journal of Intelligent and Robotic Systems
Experiments in socially guided exploration: lessons learned in building robots that learn with and without human teachers

Connection Science - Social Learning in Embodied Agents
Learning about objects with human teachers

Proceedings of the 4th ACM/IEEE international conference on Human robot interaction
Mobile human-robot teaming with environmental tolerance

Proceedings of the 4th ACM/IEEE international conference on Human robot interaction
A survey of robot learning from demonstration

Robotics and Autonomous Systems
An Embodied Cognition Approach to Mindreading Skills for Socially Intelligent Robots

International Journal of Robotics Research
Relational Learning by Imitation

KES-AMSTA '09 Proceedings of the Third KES International Symposium on Agent and Multi-Agent Systems: Technologies and Applications
Skill acquisition and use for a dynamically-balancing soccer robot

AAAI'04 Proceedings of the 19th national conference on Artifical intelligence
Perspective taking: an organizing principle for learning in human-robot interaction

AAAI'06 proceedings of the 21st national conference on Artificial intelligence - Volume 2
Reinforcement learning with human teachers: evidence of feedback and guidance with implications for learning performance

AAAI'06 Proceedings of the 21st national conference on Artificial intelligence - Volume 1
Interactive Demonstration of Pointing Gestures for Virtual Trainers

Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques
Automatic weight learning for multiple data sources when learning from demonstration

ICRA'09 Proceedings of the 2009 IEEE international conference on Robotics and Automation
Intentional context in situated natural language learning

CONLL '05 Proceedings of the Ninth Conference on Computational Natural Language Learning
Transparent active learning for robots

Proceedings of the 5th ACM/IEEE international conference on Human-robot interaction
Efficient template-based path imitation by invariant feature mapping

ROBIO'09 Proceedings of the 2009 international conference on Robotics and biomimetics
Learning multirobot joint action plans from simultaneous task execution demonstrations

Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems: volume 1 - Volume 1
Exploiting social partners in robot learning

Autonomous Robots
Teacher feedback to scaffold and refine demonstrated motion primitives on a mobile robot

Robotics and Autonomous Systems
Human and robot perception in large-scale learning from demonstration

Proceedings of the 6th international conference on Human-robot interaction
Learning from demonstration in robots: Experimental comparison of neural architectures

Robotics and Computer-Integrated Manufacturing
Interactive imitation learning of object movement skills

Autonomous Robots
Self-reproduction for articulated behaviors with dual humanoid robots using on-line decision tree classification

Robotica
Induced behavior in a real agent using the multilevel darwinist brain

IWINAC'05 Proceedings of the First international work-conference on the Interplay Between Natural and Artificial Computation conference on Artificial Intelligence and Knowledge Engineering Applications: a bioinspired approach - Volume Part II
Perceptual-Motor sequence learning via human-robot interaction

SAB'06 Proceedings of the 9th international conference on From Animals to Animats: simulation of Adaptive Behavior
Time does not always buy quality in co-evolutionary learning

SETN'10 Proceedings of the 6th Hellenic conference on Artificial Intelligence: theories, models and applications
A practical comparison of three robot learning from demonstration algorithms

HRI '12 Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction
Incremental learning of full body motion primitives and their sequencing through human motion observation

International Journal of Robotics Research
Tactile Guidance for Policy Adaptation

Foundations and Trends in Robotics
Neuro-fuzzy-based skill learning for robots

Robotica
Human-robot cross-training: computational formulation, modeling and evaluation of a human team training strategy

Proceedings of the 8th ACM/IEEE international conference on Human-robot interaction
An approach to universal interaction on the case of knowledge transfer

UAHCI'13 Proceedings of the 7th international conference on Universal Access in Human-Computer Interaction: user and context diversity - Volume 2
A syntactic approach to robot imitation learning using probabilistic activity grammars

Robotics and Autonomous Systems
Survey and analysis of current mobile learning applications and technologies

ACM Computing Surveys (CSUR)
Socially guided intrinsic motivation for robot learning of motor skills

Autonomous Robots

Quantified Score

Hi-index	0.01

Visualization

Abstract

Among humans, teaching various tasks is a complex process which relies on multiple means for interaction and learning, both on the part of the teacher and of the learner. Used together, these modalities lead to effective teaching and learning approaches, respectively. In the robotics domain, task teaching has been mostly addressed by using only one or very few of these interactions. In this paper we present an approach for teaching robots that relies on the key features and the general approach people use when teaching each other: first give a demonstration, then allow the learner to refine the acquired capabilities by practicing under the teacher's supervision, involving a small number of trials. Depending on the quality of the learned task, the teacher may either demonstrate it again or provide specific feedback during the learner's practice trial for further refinement. Also, as people do during demonstrations, the teacher can provide simple instructions and informative cues, increasing the performance of learning. Thus, instructive demonstrations, generalization over multiple demonstrations and practice trials are essential features for a successful human-robot teaching approach. We implemented a system that enables all these capabilities and validated these concepts with a Pioneer 2DX mobile robot learning tasks from multiple demonstrations and teacher feedback.