Visual support for medical communication by using projector-based augmented reality and thermal markers

Authors:
Jeremy Bluteau;Itaru Kitahara;Yoshinari Kameda;Haruo Noma;Kiyoshi Kogure;Yuichi Ohta
Affiliations:
University of Tsukuba, Tennoudai, Tsukuba, Ibaraki, Japan and Universite Joseph Fourier, Grenoble, France;University of Tsukuba, Tennoudai, Tsukuba, Ibaraki, Japan and ATR, Hikaridai, Keihanna Science City, Kyoto, Japan;University of Tsukuba, Tennoudai, Tsukuba, Ibaraki, Japan;ATR, Hikaridai, Keihanna Science City, Kyoto, Japan;ATR, Hikaridai, Keihanna Science City, Kyoto, Japan;University of Tsukuba, Tennoudai, Tsukuba, Ibaraki, Japan
Venue:
Proceedings of the 2005 international conference on Augmented tele-existence
Year:
2005

Citing 8
Cited 2

Merging virtual objects with the real world: seeing ultrasound imagery within the patient

SIGGRAPH '92 Proceedings of the 19th annual conference on Computer graphics and interactive techniques
Technologies for augmented reality systems: realizing ultrasound-guided needle biopsies

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Augmented Reality Visualization for Laparoscopic Surgery

MICCAI '98 Proceedings of the First International Conference on Medical Image Computing and Computer-Assisted Intervention
Shader Lamps: Animating Real Objects With Image-Based Illumination

Proceedings of the 12th Eurographics Workshop on Rendering Techniques
Visuo-Haptic Display Using Head-Mounted Projector

VR '00 Proceedings of the IEEE Virtual Reality 2000 Conference
Diminishing Head-Mounted Display for Shared Mixed Reality

ISMAR '02 Proceedings of the 1st International Symposium on Mixed and Augmented Reality
Experiences in Using Immersive Virtual Characters to Educate Medical Communication Skills

VR '05 Proceedings of the 2005 IEEE Conference 2005 on Virtual Reality
Medical augmented reality based on commercial image guided surgery

EGVE'04 Proceedings of the Tenth Eurographics conference on Virtual Environments

A dynamic AR marker for a paper based temperature sensor

AmI'11 Proceedings of the Second international conference on Ambient Intelligence
HeartPad: real-time visual guidance for cardiac ultrasound

Proceedings of the Workshop at SIGGRAPH Asia

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a system that allows patients and physicians to experience better communication during medical consultations using Augmented Reality (AR) technology. The AR system can superimpose augmentations (i.e., human body components) onto the real patient's body, and such annotated information serves to form the cornerstone for collaborative work between the two actors. We focus on the advantages of projector-based technology and ARToolKit. Our technique, based on thermal markers (i.e., using human body temperature as a source of information) is used for tracking the location of pain in the patient through the projected augmentations. The second aim of using thermal markers is to protect the patient's privacy. The required calibration method between thermal-camera and projector is also presented. The system's feasibility is demonstrated through development of a complete application.