Keep breathing! common motion helps multi-modal mapping

  • Authors:
  • V. De Luca;H. Grabner;L. Petrusca;R. Salomir;G. Székely;C. Tanner

  • Affiliations:
  • Computer Vision Laboratory, ETH Zürich, Zürich, Switzerland;Computer Vision Laboratory, ETH Zürich, Zürich, Switzerland;Radiology Department, Geneva University Hospital, Geneva, Switzerland;Radiology Department, Geneva University Hospital, Geneva, Switzerland;Computer Vision Laboratory, ETH Zürich, Zürich, Switzerland;Computer Vision Laboratory, ETH Zürich, Zürich, Switzerland

  • Venue:
  • MICCAI'11 Proceedings of the 14th international conference on Medical image computing and computer-assisted intervention - Volume Part I
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose an unconventional approach for transferring of information between multi-modal images. It exploits the temporal commonality of multi-modal images acquired from the same organ during free-breathing. Strikingly there is no need for capturing the same region by the modalities. The method is based on extracting a lowdimensional description of the image sequences, selecting the common cause signal (breathing) for both modalities and finding the most similar sub-sequences for predicting image feature location. The approach was evaluated for 3 volunteers on sequences of 2D MRI and 2D US images of the liver acquired at different locations. Simultaneous acquisition of these images allowed for quantitative evaluation (predicted versus ground truth MRI feature locations). The best performance was achieved with signal extraction by slow feature analysis resulting in an average error of 2.6 mm (4.2 mm) for sequences acquired at the same (a different) time.