Finger Track - A Robust and Real-Time Gesture Interface
AI '97 Proceedings of the 10th Australian Joint Conference on Artificial Intelligence: Advanced Topics in Artificial Intelligence
A non-contact mouse for surgeon-computer interaction
Technology and Health Care
| Hi-index | 0.00 |
The visualization of 3D models of the patient's body emerges as a priority in surgery. In this paper three different visualization and interaction systems are present: a virtual interface, a low cost multi-touch screen and a navigation system of medical imaging and 3D models. The systems are able to interpret in real-time the user's movements and can be used in the pre-operative planning for the navigation and manipulation of 3D models of the human body built from real patient's CT images. The surgeon has the possibility to visualize both the traditional patient information, as the TC image set, and a 3D model of the patient's anatomy built from this. The developed virtual interface is the first prototype of a system designed to avoid contact with the computer so that the surgeon will be able to visualize models of the patient's organs moving the finger in the free space. The developed multi-touch screen provides a user interface customized for doctor requirements that allows many users to interact at the same time with 3D models of the human body built from CT images. In the developed navigation and visualization system two different modalities are available in real time and dynamically: it is possible to have the automatic reslicing of the orthogonal planes exactly next to the actual position of the surgical instrument tip and to activate the clipping modality that allows cutting the 3D model in correspondence of a chosen visualization plane.