Robust real-time image-guided endoscopy: a new discriminative structural similarity measure for video to volume registration

  • Authors:
  • Xiongbiao Luo;Hirotsugu Takabatake;Hiroshi Natori;Kensaku Mori

  • Affiliations:
  • Information and Communications Headquarters, Nagoya University, Japan;Sapporo Minamisanjo Hospital, Japan;Keiwakai Nishioka Hospital, Japan;Information and Communications Headquarters, Nagoya University, Japan

  • Venue:
  • IPCAI'13 Proceedings of the 4th international conference on Information Processing in Computer-Assisted Interventions
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper proposes a fully automatic real-time robust image-guided endoscopy method that uses a new discriminative structural similarity measure for pre- and intra-operative registration. Current approaches are limited to clinical applications due to two major bottlenecks: (1) weak continuity, i.e., endoscopic guidance may be blocked since a similarity measure might incorrectly characterize video images and virtual renderings generated from pre-operative volume data, resulting in a registration failure; (2) slow computation, since volume rendering is a time-consuming step in the registration. To address the first drawback, we introduce a robust similarity measure, which uses the degradation of structural information and considers image correlation or structure, luminance, and contrast to characterize images. Moreover, we utilize graphics processing unit techniques to accelerate the volume rendering step. We evaluated our method on patient datasets. The experimental results demonstrated that we provide a promising method, which is possibly applied in the operating room, to accurately and robustly guide endoscopy in real time, particularly the average accuracy of position and orientation was improved from (14.6, 51.2) to (4.45 mm, 12.3°) and the runtime was about 32 frames per second compared to current image-guided methods.