Note: This content is accessible to all versions of every browser. However, this browser does not seem to support current Web standards, preventing the display of our site's design details.


ETH Zurich - Department of Information Technology and Electrical Engineering - Computer Vision Laboratory

Research, Prof. Gabor Székely



Non-Rigid Registration of CT/MR Data of the Spine
Participants: Adrian Andronache, Philippe Cattin, Gabor Székely

Objective: Medical image registration is a powerful tool allowing both the quantitative study of temporal image sequences and the fusion of image information acquired by different radiological modalities. The main goal is to find the proper transformation allowing the perfect overlay of images of the same object. Depending of the type of admissible transformation, registration procedures are classified as being rigid or elastic.

The first part of this project is focusing on the rigid body registration. Prototypes for both volumetric and surface-based registration have been developed, including corrections for the scanning artifacts in the acquired images.
In the second part consists in the CT/MR non-rigid registration of volumetric datasets of the spine.


Augmented Reality System - Bones Repositioning Simulator
Participants:Gerald Bianchi, Matthias Harders, Gabor Székely

Objective: In the last decade Augmented Reality (AR) systems have proved their efficiency in various application areas such as mechanical maintenance and repair, outdoor architectural design, military training. In this project, we explore a new approach for using this technology - AR based medical training. The purpose is to develop a bones repositioning simulator allowing the future surgeon to both improve her skills and reduce the risk of errors.

However, AR setups for medical applications are still a challenge because the system imposes hard constraints. Registration between the real and virtual world demands a high accuracy to maintain the illusion that the virtual object belongs to the real scene. Low latency is inevitable for achieving a real-time system. Moreover, in the context of AR simulation, we focus on parameter setting (stiffness,mass, resting length) for soft tissue models. In our current approach we employ mass-spring systems for deformation computation. These models are used for simulating the virtual muscles that are attached to the real bones.


Characterization of the Remaining Coronary Artery Motion after Stabilization
Participants:Philippe Cattin, Gabor Székely

Partner: University Hospital Zürich
Physical Electronics Laboratory, ETH Zürich
Institure of Mechatronic Systems, Zürich University of Applied Sciences, Winterthur

Extended Information: Project Homepage

Objective: Recent developments in robotic technology have enhanced surgical precision while operating through less invasive approaches in various surgical subspecialties. However, it is not surprising that use of robotics for performing coronary artery bypass surgery has been slow because of the additional challenge of perpetual cardiac motion, and the precision demanded for a graft to coronary artery anastomosis. It is herein that adding further intelligence to robotic control could probably help. The remaining motion after coronary stabilization, forces the surgeon to adapt to the movement of the heart; and this could be responsible for the inferior quality of anastomosis and increased operative time.

This study was aimed to precisely characterize all aspects of remaining coronary artery motion at a point of interest after Octopus stabilization on pig beating hearts, to understand its significance with regard to surgical precision during off-pump coronary bypass surgery (OPCAB) and to explore the possibilities of using it for mechanical motion cancellation.


Biothermofluidics for Cerebrospinal Fluid, Diagnostics & Control Development of a Knowledge Base
Participants:Peter Cech, Philippe Cattin, Gabor Székely

Partner: Laboratory for Thermodynamics in Emerging Technologies (LTNT), ETH Zürich
Measurement and Control Laboratory (IMRT), ETH Zürich
Institute of Biomedical Engineering, Biophysics Group, ETH Zürich
Neuroradiology, University Hospital Zürich
Bioengineering, Imperial College for Science, Technology and Medicine, London
CFD Research Corporation, Hunstville AL, USA
Institute of Anatomy, University of Bern

Objective: This interdisciplinary research project aims at bringing together the skills and know-how of an international group of experts for realizing a multifaceted investigation of the cerebrospinal fluid flow and transport phenomena within the cranial cavity and part of the spinal cord. The part held at the Computer Vision Laboratory deals with extraction of the cerebrospinal fluid space geometry. A generic model of the ventricular system's geometry, that will be used in development of cerebrospinal fluid flow simulation, is prepared in the first stage. Subsequent efforts are aimed at developing a semiautomatic process for extracting the patient-specific cerebrospinal fluid space geometry. Both the acquisition of the initial data and the data processing algorithm must be adapted to the requirements of the daily clinical praxis.


Development of a generic model of organ motion for use in radiotherapy treatment planning
Participants:Martin von Siebenthal, Philippe Cattin, Gabor Székely

Partner: Division of Radiation Medicine, PSI
Institure of Biomechanical Engineering, ETHZ/UNIZ

Objective: Treatment planning is a key element in the state of the art delivery radiotherapy. By using intensity modulated radiotherapy (IMRT) and especially intensity modulated proton therapy (IMPT), highly conformal dose distributions can be delivered to a tumour. Unfortunately, in the presence of organ motions, the form of the delivered dose will be strongly influenced by interaction of the time-varying delivery hardware and the motion of the organs.

The main goal of this project is to develop statistical methods to model organ motion effects at the treatment planning stage in order to estimate the problem's extent for dynamic treatments and to compare different delivery methodologies from the organ motion sensitivity point of view.


Hysteroscopy Simulator
Participants:Matthias Harders, Raimundo Sierra, Janos Zatonyi, Rupert Paget, Dominik Szczerba, Gabor Székely

Partner: Computer Graphics Laboratory, ETH Zürich
Institute of Biomechanical Engineering, ETH Zürich
Institute for Mechanical Systems, ETH Zürich
Institute of Computational Science, ETH Zürich
Micromachines and Precision Instrumentation Lab, EPFL Lausanne
Clinic of Gynecology, Dept. OB/GYN, University Hospital Zürich

Objective: Hysteroscopy is the second most often performed endoscopic procedure in gynaecology and is mostly part of any specialization program for gynaecology. It is to be expected that training on a reasonably realistic simulator could substantially contribute to reduce the rate of complications. The simulator will allow realistic real-time visualization of the intervention scene including changes due to surgical actions and the control of the hydrometra by manipulating the liquid influx and efflux as well as realistic tactile sensation.

The following components provided by all partners will be integrated into the simulator:
  • Mechanical modeling module based on basic components for tissue deformation calculation and real-time cutting
  • Specialized force-feedback instrument emulating the hysteroscope
  • Visualization algorithms for reasonably realistic presentation of the interventional field
  • Generation of anatomical models for the simulation, covering a possibly large range of pathologies
Clinical evaluation will be carried out in order to gain insight into which level of realism is needed to actually reach the goals of efficient surgical training on VR-based trainer, with special emphasis on visual fidelity and the presence and quality of force feedback.

Please also have a look at a former surgery simulation project in our lab.


Automatic Segmentation of Vessels and the Identification of Vascular Pathology
Participants:Tamas Kovacs, Philippe Cattin, Simon Wildermuth, Gabor Székely

Partner: Institufe of Diagnostic Radiology, University Zürich

Objective: Vessel segmentation is a key component of every radiological diagnostic system. However, the lack of robust methods still forces radiologists to spend a considerable amount of their time to manually segment and analyze the vessels in CT or MR data.

Our final goal is the development of automatic vessel segmentation methods that not only allow to detect vessels but also recognize diseases such as aneurysms or dissections. For the design and implementation of the application we plan to use the modular ILAB4 platform (developed by Mevis, Bremen), that greatly improves development cycles.


Haptic Soft Tissue Interaction
Participants:Peter Leskovsky, Mattias Harders, Gabor Székely

Partner: Technical University Berlin
Max Planck Institute for Biological Cybernetics
University of Pisa
Universite d'Evry Val-d'Essonne
University of Birmingham

Extended Information: Additional Links

Objective: It is well known that haptic devices can enhance the perception of reality in virtual environments. The touch and force sensation is an important component of surgical simulators, which are currently widely developed at many research centers and companies to help the doctors to acquire special skills needed in the surgery.

We are going to focus on possible techniques in haptic rendering for a newly developed 6 Degree Of Freedom (DOF) force feedback device in the context of open surgery simulator. The interaction with virtual organs via simple surgical devices like scalpels and scissors will be modeled. Furthermore the possibilities of direct tissue palpation will be explored. Especially the impact of the new devices and paradigms will be studied.

The main emphasis will be on the technical view of contact mechanics as well as to simplifications made for achievieng real-time haptic rendering.


Texturing for Hysteroscopic Surgery Simulator
Participants:Rupert Paget, Janos Zatonyi, Gabor Székely

Partner: University Hospital Zürich

Objective: Hysteroscopy is the visualisation of the inner surface of the uterus performed by inserting both the endoscope and the surgical instrument through the cervix into the uterus. Therapeutic hysteroscopy is associated with a certain number of known serious complications, that can be best addressed through repetitive training by the surgeon. A hysteroscopic virtual-reality surgical simulator that provides realistic and configurable training environment is seen as the ideal solution to providing this repetitive training.

Texture synthesis for the Hysteroscopic surgical simulator will need to address the following:
  • Texture mapping of inner surface of uterus
  • Texture mapping of subsurface of uterus.
  • Blood flow in distension fluid.
  • Flowing debris cloud.
  • Bubbles.
  • Vibrating endometrium material.
Any proposed solution to these areas needs to be implementable in real-time, while presenting a visual experience that is as close to life-like as possible.


Automatic patellar cartilage segmentation from 3D MRI data volumes
Participants:Cristian Pirnog, Gabor Székely

Partner: Laboratory for Biomechanics, ETH Zürich

Objective: Segmentation of organs is an important and very difficult step in the process of medical image analysis. The main effect of the fast development of medical imaging techniques (and especially MRI) is the huge amount of data that becomes available and must be analyzed by the physicians. In this context, tools for automatic segmentation are extremely important. This project aims for developing such a tool which will allow automatic segmentation of the patellar cartilage of the knee joint from multi-slice magnetic resonance images, taken under clinically applicable conditions. The considered approach is to combine local feature analysis methods with a model based approach, allowing robust segmentation even in the unavoidable presence of noise and artifacts.


Mosaicking of Endoscopic Placenta Images to Assist Treatment of the Twin to Twin Transfusion Syndrome
Participants:Mireille Reeff, Philippe Cattin, Gabor Székely

Partner: University Hospital Zürich

Extended Information: Project Homepage

Objective: The Twin to Twin Transfusion Syndrome (TTTS) is a disease of the placenta. It affects identical monochorionic (shared placenta) twins during pregnancy where blood passes from one baby to the other through abnormal vascular connections within their shared placenta. One baby, the recipient twin, gets too much blood that might overload his cardiovascular system and might die from heart failure. The other baby, the donor twin, does not get enough blood and may die from severe anemia. The tragedy is that these babies are healthy. The problem is in the placenta. The death rate for twins who develop TTTS at mid-pregnancy may be as high as 80 to 100 percent. Babies may die in utero, at birth from prematurity or years later from the effects of TTTS. Those who survive suffer from many serious problems, including cerebral palsy.

This disease can be treated by endoscopic laser surgery. The procedure uses an endoscope to identify, and a laser to coagulate, the connecting vessels in the placenta and block the passage of blood from one twin to the other.

The procedure for identifying the abnormal connections is not so easy. The endoscope has a small field of view and the obtained images show severe lens distortions and suffer from weak visibility in the amniotic fluid. This makes it difficult for the surgeon to ensure that all the abnormal vascular connections have been found and treated accordingly.

This project consists of two phases: the first phase is devoted to the calibration of the endoscope, in order to eliminate the lens distortion in the images. The second phase comprises of the construction of a mosaic of the entire placenta with these small images. This will give the surgeon a map of the entire placenta, on which he can easily detect all the abnormal connecting vessels.


Generation of Anatomical Models for Surgical Simulators
Participants:Raimundo Sierra, Gabor Székely

Partner: Clinic of Gynecology, Dept. OB/GYN, University Hospital Zürich

Extended Information: Project Homepage

Objective: In the past few years virtual reality based systems have been proposed and realized for many medical interventions. These simulators have the potential to provide training on a wide variety of pathologies. So far, realistic generation of anatomical variance and pathologies have not been treated as a specific issue. It has to be possible for a physician to generate an individual surgical scene for every training session.

This research will explore how to generate such anatomical models for surgical simulators considering the natural variability of the healthy anatomy and seamlessly integrating a wide spectrum of different pathologies according to the specifications from physicians.


Haptic Interaction with 3-Dimensional CT Data
Participants:Christoph Spuhler, Matthias Harders Gabor Székely

Partner: Technical University Berlin
Max Planck Institute for Biological Cybernetics
University of Pisa
Universite d'Evry Val-d'Essonne
University of Birmingham

Extended Information: Additional Links

Objective: Diagnosis of medical ailments is increasingly done through CT (Computer Tomography) and MRI (Magnetic Resonance Imaging) images. These images are constantly improving in resolution and quality. However, due to the 3-Dimensional nature of these images, it is often hard not to become confused and overwhelmed by the displayed information. We are working on a program which renders 3D CT or MRI images to the screen using volume-rendering. Intelligent haptic (touch) feedback is provided from the data, allowing the user to "feel" as well as see the data (using the Sensable Phantom Device: www.sensable.com). This includes a technique which guides the user along the path of the intestine using Euclidean Distance Maps to calculate the forces. The user feels a force pushing the cursor towards the center of the intestine, allowing for fast and easy navigation along the winding turns of the intestine. This in turn allows the segmentation (separation from the remaining data) of the intestine by the drawing of a center-line, and the diagnosis of polyps inside the intestine.


Modeling of blood vessels in the uterus
Participants:Dominik Szczerba, Gabor Székely

Objective: Angiogenesis, the growth of vascular structures, is an extremely complex biological process which has long puzzled scientists. Better physiological understanding of this phenomenon could result in many useful medical applications, from virtual surgery simulators for medical interventions, to cancer therapy, where e.g. influence of certain factors on the system could be simulated. Although there is a lot of research being done on blood circulatory systems and many models with high level of mathematical sophistication have already been proposed, most of them offer very modest visual quality and not satisfactory physiological insight for the resultant vascularities. This work is a proposition of a macroscopic model allowing for generation of various vascular systems with high graphical fidelity for simulation purposes.


Surgical scene visualization - Synthesis of bleeding for Virtual Hysteroscopy
Participants:Janos Zatonyi, Rupert Paget, Gabor Székely

Extended Information: Project Homepage

Objective: In a realistic hysteroscopic simulator special interest has to be devoted to the simulation of intra-uterine bleeding, influencing the visibility of the surgical scene, until the correct adjustment of the inflow and outflow valves on the instrument are performed by the surgeon.

The aim of this project is to develop a computer model that can produce a visually appealing reconstruction of bleeding for hysteroscopic simulator. Therefore, our task incorporates the needs for real-time synthesis and responsiveness of the model to any actions introduced by the surgeon to the dynamic virtual reality environment.


Quantitative Endoscopy
Participants:Christian Wengert, Philippe Cattin, Gabor Székely

Partner: Maurice E. Mueller Institute
Institute for Surgical Technology and Biomechanics
Virtual Reality and Active Interfaces Group, Swiss Federal Institute of Technology Lausanne

Objective: Quantitative Endoscopy is a promising field combining state of the art in computer vision and medicine. We are currently developing real-time algorithms for such improved endoscopes using 3D reconstruction techniques in order to enable quantitative measures during surgery. As endoscopic videos shows only few very distinct features, the images are severely distorted and as the whole processing must be real-time, this is a very challenging task.

In a second phase of this project, we want to investigate scenes with more complex movements for which we will provide the parameterized models (such as breathing).