Pointing Gestures for a Robot Mediated Communication Interface

Authors:
John-John Cabibihan;Wing Chee So;Medi Nazar;Shuzhi Sam Ge
Affiliations:
Social Robotics Laboratory, Interactive and Digital Media Institute, and Department of Electrical and Computer Engineering,;Department of Psychology, National University of Singapore, Singapore;Department of Electrical and Computer Engineering,;Social Robotics Laboratory, Interactive and Digital Media Institute, and Department of Electrical and Computer Engineering,
Venue:
ICIRA '09 Proceedings of the 2nd International Conference on Intelligent Robotics and Applications
Year:
2009

Citing 2
Cited 2

The VideoWindow system in informal communication

CSCW '90 Proceedings of the 1990 ACM conference on Computer-supported cooperative work
Being together: user’s subjective experience of social presence in CMC environments

HCI'07 Proceedings of the 12th international conference on Human-computer interaction: interaction design and usability

Selecting when acting: how human perception is tuned to action goals and how robotics can benefit from that

ICSR'10 Proceedings of the Second international conference on Social robotics
Making robots persuasive: the influence of combining persuasive strategies (gazing and gestures) by a storytelling robot on its persuasive power

ICSR'11 Proceedings of the Third international conference on Social Robotics

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper asked whether the pointing gesture accompanying with speech would facilitate comprehension of spatial information in the videoconference communication. Ten adults participated in our study and communicated with the experimenter over Skype (Skype Technologies, Luxembourg). The experimenter described the spatial layout of items in a room to the participants in two conditions --- dynamic and static. In the static condition, the notebook was not moving; in the dynamic condition, the notebook moved around with the arms pointing to abstract spatial locations that represented the locations of items in the room. The movement was done by putting the notebook on the three-wheeled Wi-Fi enabled device that was equipped with two artificial arms and was controlled by the experimenter over the Internet. At the end of each description, the participants were asked to lay out the items properly. Reaction times and accuracy rate were recorded. The findings showed that the accuracy rate was higher in the dynamic condition than in the static condition. In addition, the response time was faster in the dynamic condition than in the static condition. It turned out that pointing gestures facilitated the speech comprehension of spatial information.