Gestonurse: a multimodal robotic scrub nurse

Authors:
Mithun George Jacob;Yu-Ting Li;Juan P. Wachs
Affiliations:
Purdue University, West Lafayette, IN, USA;Purdue University, West Lafayette, IN, USA;Purdue University, West Lafayette, IN, USA
Venue:
HRI '12 Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction
Year:
2012

Citing 0
Cited 2

Collaboration with a robotic scrub nurse

Communications of the ACM
Context-based hand gesture recognition for the operating room

Pattern Recognition Letters

Quantified Score

Hi-index	0.02

Visualization

Abstract

A novel multimodal robotic scrub nurse (RSN) system for the operating room (OR) is presented. The RSN assists the main surgeon by passing surgical instruments. Experiments were conducted to test the system with speech and gesture modalities and average instrument acquisition times were compared. Experimental results showed that 97% of the gestures were recognized correctly under changes in scale and rotation and that the multimodal system responded faster than the unimodal systems. A relationship similar in form to Fitts's law for instrument picking accuracy is also presented.