A non-contact mouse for surgeon-computer interaction

Authors:
C. Grä/tzel;T. Fong;S. Grange;C. Baur
Affiliations:
Institut de production et robotique, Ecole Polytechnique Fé/dé/rale de Lausanne, CH-1015 Lausanne, Switzerland;(Correspd. IPR-LSRO Tel.: +41 21 693 78 14/ Fax: +41 21 693 65 40/ E-mail: terrence.fong@epfl.ch) Institut de production et robotique, Ecole Polytechnique Fé/dé/rale de Lausanne, CH-1015 L ...;Institut de production et robotique, Ecole Polytechnique Fé/dé/rale de Lausanne, CH-1015 Lausanne, Switzerland;Institut de production et robotique, Ecole Polytechnique Fé/dé/rale de Lausanne, CH-1015 Lausanne, Switzerland
Venue:
Technology and Health Care
Year:
2004

Citing 0
Cited 17

M/ORIS: a medical/operating room interaction system

Proceedings of the 6th international conference on Multimodal interfaces
The visual keyboard: Real-time feet tracking for the control of musical meta-instruments

Image Communication
Gesture Based Interface for Crime Scene Analysis: A Proposal

ICCSA '08 Proceedings of the international conference on Computational Science and Its Applications, Part II
An Advanced Modality of Visualization and Interaction with Virtual Models of the Human Body

ICDHM '09 Proceedings of the 2nd International Conference on Digital Human Modeling: Held as Part of HCI International 2009
Active, a tool for building intelligent user interfaces

ASC '07 Proceedings of The Eleventh IASTED International Conference on Artificial Intelligence and Soft Computing
Non-rigid shape recognition for sign language understanding

WSEAS TRANSACTIONS on SYSTEMS
Vision-based hand-gesture applications

Communications of the ACM
Advanced interfaces of interactions with virtual organs for surgical pre-operative planning

SSIP '09/MIV'09 Proceedings of the 9th WSEAS international conference on signal, speech and image processing, and 9th WSEAS international conference on Multimedia, internet & video technologies
Exploring the potential for touchless interaction in image-guided interventional radiology

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Direct surgeon control of the computer in the operating room

MICCAI'11 Proceedings of the 14th international conference on Medical image computing and computer-assisted intervention - Volume Part I
Learning gestures for customizable human-computer interaction in the operating room

MICCAI'11 Proceedings of the 14th international conference on Medical image computing and computer-assisted intervention - Volume Part I
Vision-based user interfaces for health applications: a survey

ISVC'06 Proceedings of the Second international conference on Advances in Visual Computing - Volume Part I
An adaptive solution for intra-operative gesture-based human-machine interaction

Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
Interaction proxemics and image use in neurosurgery

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
On the naturalness of touchless: Putting the “interaction” back into NUI

ACM Transactions on Computer-Human Interaction (TOCHI) - Special issue on the theory and practice of embodied interaction in HCI and interaction design
Touchless interaction in surgery

Communications of the ACM
Context-based hand gesture recognition for the operating room

Pattern Recognition Letters

Quantified Score

Hi-index	0.03

Visualization

Abstract

We have developed a system that uses computer vision to replace standard computer mouse functions with hand gestures. The system is designed to enable non-contact human-computer interaction (HCI), so that surgeons will be able to make more effective use of computers during surgery. In this paper, we begin by discussing the need for non-contact computer interfaces in the operating room. We then describe the design of our non-contact mouse system, focusing on the techniques used for hand detection, tracking, and gesture recognition. Finally, we present preliminary results from testing and planned future work.