This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Keep Breathing! Common Motion Helps Multi-modal Mapping

V. De Luca, H. Grabner, L. Petrusca, R. Salomir, G. Székely, C. Tanner
Berlin Heidelberg 2011


We propose an unconventional approach for transferring of information between multi-modal images. It exploits the temporal commonality of multi-modal images acquired from the same organ during free-breathing. Strikingly there is no need for capturing the same region by the modalities. The method is based on extracting a lowdimensional description of the image sequences, selecting the common cause signal (breathing) for both modalities and finding the most similar sub-sequences for predicting image feature location. The approach was evaluated for 3 volunteers on sequences of 2D MRI and 2D US images of the liver acquired at different locations. Simultaneous acquisition of these images allowed for quantitative evaluation (predicted versus ground truth MRI feature locations). The best performance was achieved with signal extraction by slow feature analysis resulting in an average error of 2.6 mm (4.2 mm) for sequences acquired at the same (a different) time.

Download in pdf format
  author = {V. De Luca and H. Grabner and L. Petrusca and R. Salomir and G. Székely and C. Tanner},
  title = { Keep Breathing! Common Motion Helps Multi-modal Mapping},
  booktitle = {MICCAI 2011},
  year = {2011},
  pages = {597–604},
  volume = {6891},
  editor = {G. Fichtinger and A. Martel and and T. Peters},
  series = {Lecture Notes in Computer Science},
  publisher = {Springer-Verlag},
  keywords = {motion prediction, multi-modal, ultrasound, magnetic resonance images, tracking, liver}