Medical augment reality using a markerless registration framework

Authors:
Jiann-Der Lee;Chung-Hsien Huang;Tsing-Che Huang;Hui-Yuan Hsieh;Shin-Tseng Lee
Affiliations:
Department of Electrical Engineering, Chang Gung University, 259 Wen-Hwa 1st Road, Kuei Shan Hsiang, Taoyuan Hsien, Taiwan, ROC;Department of Electrical Engineering, Chang Gung University, 259 Wen-Hwa 1st Road, Kuei Shan Hsiang, Taoyuan Hsien, Taiwan, ROC;Department of Electrical Engineering, Chang Gung University, 259 Wen-Hwa 1st Road, Kuei Shan Hsiang, Taoyuan Hsien, Taiwan, ROC;Department of Electrical Engineering, Chang Gung University, 259 Wen-Hwa 1st Road, Kuei Shan Hsiang, Taoyuan Hsien, Taiwan, ROC;Department of Neurosurgery, Chang Gung Memorial Hospital, 5, Fu-Hsing Street, Kuei Shan Hsiang, Taoyuan Hsien, Taiwan, ROC and Medical Augmented Reality Research Center, Chang Gung Memorial Hospit ...
Venue:
Expert Systems with Applications: An International Journal
Year:
2012

Citing 10
Cited 1

A Method for Registration of 3-D Shapes

IEEE Transactions on Pattern Analysis and Machine Intelligence - Special issue on interpretation of 3-D scenes—part II
A Stochastic Iterative Closest Point Algorithm (stochastICP)

MICCAI '01 Proceedings of the 4th International Conference on Medical Image Computing and Computer-Assisted Intervention
Multiple View Geometry in Computer Vision

Multiple View Geometry in Computer Vision
Modelling the Stereovision-Correspondence-Analysis task by Lateral Inhibition in Accumulative Computation problem-solving method

Expert Systems with Applications: An International Journal
3D registration using a new implementation of the ICP algorithm based on a comprehensive lookup matrix: Application to medical imaging

Pattern Recognition Letters
Using backpropagation neural network for face recognition with 2D+3D hybrid information

Expert Systems with Applications: An International Journal
Visualization and interaction of pervasive services using context-aware augmented reality

Expert Systems with Applications: An International Journal
Intelligent extended floating car data collection

Expert Systems with Applications: An International Journal
A Modified Soft-Shape-Context ICP Registration System of 3-D Point Data

IEICE - Transactions on Information and Systems
Visual and tangible interactions with physical and virtual objects using context-aware RFID

Expert Systems with Applications: An International Journal

Direct hand touchable interactions in augmented reality environments for natural and intuitive user experiences

Expert Systems with Applications: An International Journal

Quantified Score

Hi-index	12.05

Visualization

Abstract

This study proposes a cranial augmented-reality (AR) system which characterizes on performing image-to-patient registration using only natural facial features. Its hardware includes only three calibrated CCD cameras but any commercial spatial digitizing devices or artificial skin markers. Two of the cameras are mounted together to form a stereo-vision system, while the third camera moves freely and captures real-time images for AR-fusion display. The facial surface of a patient is first reconstructed by stereo vision. Meanwhile, another facial surface is reconstructed from preoperative computed tomography (CT) images of the patient. A iterative closest point (ICP)-based algorithm is then used to register the two facial data sets, which transfers the anatomical information from the CT images to the physical space. Since the natural of stereo-vision reconstruction usually accompanies with noisy data, the conventional ICP also suffers from its inherent local-minimum problem. Therefore, we propose an improved ICP which embeds a weighting and perturbing strategy to increase robustness and the ability of noise resistance. As a result, with a seamless integration among the preoperative CT images, the patient, the stereo-vision cameras, and the movable camera, an immersive medical AR environment based on a markerless image-to-patient registration is thus accomplished.