Integration of a low-cost RGB-D sensor in a social robot for gesture recognition

Authors:
Arnaud Ramey;Víctor González-Pacheco;Miguel A. Salichs
Affiliations:
University of Carlos III of Madrid, Leganés, Spain;University of Carlos III of Madrid, Leganés, Spain;University of Carlos III of Madrid, Leganés, Spain
Venue:
Proceedings of the 6th international conference on Human-robot interaction
Year:
2011

Citing 2
Cited 4

Toward natural interaction through visual recognition of body gestures in real-time

Interacting with Computers
Gesture Recognition: A Survey

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews

A social robot as an aloud reader: putting together recognition and synthesis of voice and gestures for HRI experimentation

HRI '12 Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction
A comparative study of calibration methods for Kinect-style cameras

Proceedings of the 5th International Conference on PErvasive Technologies Related to Assistive Environments
Real-time gesture recognition for the high-level teleoperation interface of a mobile manipulator

Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction
Morphological gender recognition by a social robot and privacy concerns: late breaking reports

Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

An objective of natural Human-Robot Interaction (HRI) is to enable humans to communicate with robots in the same manner humans do between themselves. This includes the use of natural gestures to support and expand the information that is exchanged in the spoken language. To achieve that, robots need robust gesture recognition systems to detect the non-verbal information that is sent to them by the human gestures. Traditional gesture recognition systems highly depend on the light conditions and often require a training process before they can be used. We have integrated a low-cost commercial RGB-D (Red Green Blue - Depth) sensor in a social robot to allow it to recognise dynamic gestures by tracking a skeleton model of the subject and coding the temporal signature of the gestures in a FSM (Finite State Machine). The vision system is independent of low light conditions and does not require a training process.