Real-time image composition of bladder mosaics in fluorescence endoscopy

  • Authors:
  • Alexander Behrens;Michael Bommes;Thomas Stehle;Sebastian Gross;Steffen Leonhardt;Til Aach

  • Affiliations:
  • Institute of Imaging & Computer Vision, RWTH Aachen University, Aachen, Germany;Institute of Imaging & Computer Vision, RWTH Aachen University, Aachen, Germany;Institute of Imaging & Computer Vision, RWTH Aachen University, Aachen, Germany;Institute of Imaging & Computer Vision, RWTH Aachen University, Aachen, Germany;Philips Chair for Medical Information Technology, Helmholtz-Institute, RWTH Aachen University, Aachen, Germany;Institute of Imaging & Computer Vision, RWTH Aachen University, Aachen, Germany

  • Venue:
  • Computer Science - Research and Development
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Today, photodynamic diagnostics is commonly used in endoscopic intervention of the urinary bladder. Excited by a narrow band illumination, fluorescence markers enhance the visual contrast between benign and malignant tissue. Since in this modality the endoscope must be moved close to the bladder wall to provide sufficiently exposed images, the field of view (FOV) of the endoscope is very limited. This impedes the navigation and the re-identifying of multi-focal tumors for the physician. Thus, an image providing a larger FOV, composed from single images is highly desired during the intervention for surgery assistance. Since endoscopic mosaicking in real-time is still an open issue, we introduce a new feature-based image mosaicking algorithm for fluorescence endoscopy. Using a multi-threaded software design, the extraction of SURF features, the matching and the image stitching are separated in single processing threads. In an optimization step we discuss the trade-off between feature repeatability and processing time. After adjusting an optimal thread synchronization, the optimal workload of each thread results in a fast and real-time capable computation of image mosaics. On a standard hardware platform our algorithm performs within the RealTimeFrame framework with an update rate of 8.17 frames per second at full input image resolution (780脳576). Providing a fast growing image with an extended FOV during the intervention, the mosaic displayed on a second monitor promises high potential for surgery assistance.