Human Control of UAVs using Face Pose Estimates and Hand Gestures

Authors:
Jawad Nagi;Alessandro Giusti;Gianni A. Di Caro;Luca M. Gambardella
Affiliations:
Dalle Molle Institute for Artificial Intelligence (IDSIA), Lugano, Switzerland;Dalle Molle Institute for Artificial Intelligence (IDSIA), Lugano, Switzerland;Dalle Molle Institute for Artificial Intelligence (IDSIA), Lugano, Switzerland;Dalle Molle Institute for Artificial Intelligence (IDSIA), Lugano, Switzerland
Venue:
Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction
Year:
2014

Citing 2
Cited 0

Robust Real-Time Face Detection

International Journal of Computer Vision
Selecting and commanding groups in a multi-robot vision based system

Proceedings of the 6th international conference on Human-robot interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

As a first step towards human and multiple-UAV interaction, we present a novel method for humans to interact with flying UAVs using locally on-board video cameras. Using machine vision techniques, our approach enables human operators to command and control Parrot drones by giving them directions to move, using simple hand gestures. When a direction to move is given, the robot controller estimates the angle and distance to move with the help of a face score system and the estimated hand direction. This approach offers mobile robots the ability localize with human operators and provides UAVs/UGVs with a better perception of the environment around the human.