Context and consciousness: activity theory and human-computer interaction
Context and consciousness: activity theory and human-computer interaction
The visual analysis of human movement: a survey
Computer Vision and Image Understanding
Activity monitoring: noticing interesting changes in behavior
KDD '99 Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining
The Recognition of Human Movement Using Temporal Templates
IEEE Transactions on Pattern Analysis and Machine Intelligence
A survey of computer vision-based human motion capture
Computer Vision and Image Understanding - Modeling people toward vision-based underatanding of a person's shape, appearance, and movement
An Augmentation System for Fine Manipulation
MICCAI '00 Proceedings of the Third International Conference on Medical Image Computing and Computer-Assisted Intervention
Activity rhythm detection and modeling
CHI '03 Extended Abstracts on Human Factors in Computing Systems
Detection and Estimation of Pointing Gestures in Dense Disparity Maps
FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Activity monitoring and summarization for an intelligent meeting room
HUMO '00 Proceedings of the Workshop on Human Motion (HUMO'00)
A Reliable-Inference Framework for Recognition of Human Actions
AVSS '03 Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance
Activity theory: basic concepts and applications
CHI EA '97 CHI '97 Extended Abstracts on Human Factors in Computing Systems
A non-contact mouse for surgeon-computer interaction
Technology and Health Care
The long-term adoption of speech recognition in medical applications
CBMS'03 Proceedings of the 16th IEEE conference on Computer-based medical systems
Vision-based hand-gesture applications
Communications of the ACM
Estimating the perceived difficulty of pen gestures
INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part II
Direct surgeon control of the computer in the operating room
MICCAI'11 Proceedings of the 14th international conference on Medical image computing and computer-assisted intervention - Volume Part I
Vision-based user interfaces for health applications: a survey
ISVC'06 Proceedings of the Second international conference on Advances in Visual Computing - Volume Part I
Context-based hand gesture recognition for the operating room
Pattern Recognition Letters
| Hi-index | 0.02 |
We propose an architecture for a real-time multimodal system, which provides non-contact, adaptive user interfacing for Computer-Assisted Surgery (CAS). The system, called M/ORIS (for Medical/Operating Room Interaction System) combines gesture interpretation as an explicit interaction modality with continuous, real-time monitoring of the surgical activity in order to automatically address the surgeon's needs. Such a system will help reduce a surgeon's workload and operation time. This paper focuses on the proposed activity monitoring aspect of M/ORIS. We analyze the issues of Human-Computer Interaction in an OR based on real-world case studies. We then describe how we intend to address these issues by combining a surgical procedure description with parameters gathered from vision-based surgeon tracking and other OR sensors (e.g. tool trackers). We called this approach Scenario-based Activity Monitoring (SAM). We finally present preliminary results, including a non-contact mouse interface for surgical navigation systems.