Improving ultrasound intensity-based visual servoing: Tracking and positioning tasks with 2D and bi-plane probes

Real time and non invasive, the ultrasound imaging modality can easily be used in minimally invasive surgery or needle insertion procedures to visualize an organ or a tumor to reach. However the manual stabilization of the ultrasound image while the organ moves with patient breathing or heart beating can be very tricky. In this paper, we present an intensity-based approach to control both in-plane and out-of-plane motions of an ultrasound probe held by a robotic arm in order to reach and follow one organ cross section. Two methods are proposed to improve the accuracy of this intensity-based approach, by estimating on-line the 3D image gradient required in the control law and by considering a bi-plane sensor. Robotic experiments are performed with two different ultrasound sensors on a realistic abdominal phantom and validate this visual servoing approach.