Robust 3D tracking for robotic-assisted beating heart surgery

Robotic assistance aims to make the surgical act more intuitive and safer. In the domain of cardiac minimally invasive surgery (MIS,) heartbeat and respiration represent two important sources of disturbances. Even though miniaturized versions of heart stabilizers have been conceived for the MIS scenario, residual motion is still considerable and has to be manually canceled by the surgeon. This work focuses on computer vision techniques for estimating the 3D motion of the heart relying solely on natural structures on the heart surface for active compensation of physiological motions. A visual tracking method for estimating the 3D deformation of a region of interest on the heart surface based on the visual feedback of a stereo endoscope has been developed. The method is robust to illumination variations and large tissue deformations.